00000001:02000400:0.0F:1787779330.375184:0:2959:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg109-server.virtnet: executing set_hostid 00000001:02000400:1.0F:1787779350.798248:0:3180:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg109-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1787779352.733527:0:3243:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 811 MB/s 00000001:01000000:3.0F:1787779352.983651:0:3243:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1051 MB/s 00000001:01000000:0.0:1787779353.233306:0:3243:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 6075 MB/s 00000020:02000000:3.0:1787779354.201544:0:3273:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_57_g44c575c 00000400:02000000:1.0:1787779355.434687:0:3288:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.201.109@tcp [8/256/0/180] 00008000:02000000:0.0:1787779359.674765:0:3437:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1787779415.466603:0:5238:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg109-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1787779427.821786:0:5817:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787779427.821792:0:5817:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1787779427.822002:0:5817:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000d9049ba2 00000080:02000400:1.0:1787779427.822014:0:5817:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1787779427.826699:0:5817:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1787779427.826931:0:5817:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787779427.827357:0:5817:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000e7514565) 00000020:00000080:2.0:1787779427.827380:0:5817:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1787779427.842686:0:5817:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1787779427.843404:0:5817:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1787779427.869348:0:5817:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1787779427.869408:0:5817:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1787779427.869432:0:5817:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1787779427.869523:0:5817:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1787779427.869553:0:5817:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1787779427.870032:0:5817:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1787779427.870042:0:5817:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787779427.870053:0:5817:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9e63ba8af6888c49 00000020:01000004:0.0:1787779427.870061:0:5817:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:0.0:1787779427.870067:0:5817:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1787779427.870072:0:5817:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000d9049ba2 from MGS 00000020:01000004:0.0:1787779427.870077:0:5817:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1787779427.870109:0:5817:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000417a11de) 00000020:00000080:0.0:1787779427.870121:0:5817:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1787779427.870195:0:5817:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000d9049ba2 from MGS, refs=2 00080000:01000000:0.0:1787779427.870201:0:5817:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787779427.870206:0:5817:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9e63ba8af6888c57 00000100:00100000:0.0:1787779427.870313:0:5817:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1787779427.870458:0:5817:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1787779427.870465:0:5817:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1787779427.872789:0:5817:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1787779427.872803:0:5817:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1787779427.875185:0:5817:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787779427.875434:0:5817:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1787779427.875441:0:5817:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1787779427.876466:0:5817:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1787779427.876480:0:5817:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1787779427.877431:0:5817:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1787779427.877440:0:5817:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1787779427.878682:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779427.878688:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779427.878690:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779427.879199:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779427.879202:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779427.879204:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787779427.879704:0:5817:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1787779427.887848:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1787779428.128956:0:5817:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2183 MB/s 00000001:01000000:2.0:1787779428.379086:0:5817:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3307 MB/s 00000001:01000000:3.0:1787779428.629232:0:5817:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 615 MB/s 00000001:01000000:2.0:1787779428.880013:0:5817:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 613 MB/s 00080000:10000000:3.0:1787779428.904046:0:5817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:1.0:1787779428.920694:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1787779428.933553:0:5817:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1787779428.933589:0:5817:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787779428.933592:0:5817:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1787779428.937144:0:5827:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1787779428.937220:0:5817:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1787779428.937299:0:5817:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1787779428.937566:0:5817:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1787779428.937594:0:5817:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1787779428.937964:0:5817:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787779428.938117:0:5817:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1787779428.938122:0:5817:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1787779428.945512:0:5817:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1787779428.945527:0:5817:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1787779428.946179:0:5817:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1787779428.946187:0:5817:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1787779428.947065:0:5817:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1787779428.947087:0:5817:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.109@tcp' 00000020:01000004:1.0:1787779428.947089:0:5817:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1787779428.947146:0:5817:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.109@tcp (typ=mgc) 00000020:00000080:1.0:1787779428.947167:0:5817:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.109@tcp (00000000d52d8d71) 00000020:00000080:1.0:1787779428.947182:0:5817:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1787779428.947339:0:5817:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000b23c3478@MGC192.168.201.109@tcp: add connection 192.168.201.109@tcp at head 00010000:00010000:1.0:1787779428.947496:0:5817:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.109@tcp-0 is initialized 00000040:01000000:1.0:1787779428.947502:0:5817:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.109@tcp ctxt 1 is initialized 00000100:00080000:0.0:1787779428.948097:0:5832:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1787779428.949671:0:5833:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1787779428.957451:0:5817:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.109@tcp (uuid c28aae66-2825-42c5-8f52-61f687e868c9) 00000020:00000080:1.0:1787779428.957481:0:5817:0:(genops.c:1385:class_connect()) connect: client c28aae66-2825-42c5-8f52-61f687e868c9, cookie 0x9e63ba8af6888c65 00000100:00080000:1.0:1787779428.957494:0:5817:0:(import.c:510:import_select_connection()) MGC192.168.201.109@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787779428.957500:0:5817:0:(import.c:624:import_select_connection()) MGC192.168.201.109@tcp: import 00000000b23c3478 using connection 192.168.201.109@tcp/0@lo 00000100:00100000:1.0:1787779428.957533:0:5817:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000cb634764 x1874622524948608/t0(0) o250->MGC192.168.201.109@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787779428.957559:0:5817:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import c28aae66-2825-42c5-8f52-61f687e868c9->MGS 00000020:01000004:1.0:1787779428.957576:0:5817:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1787779428.957581:0:5817:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1787779428.957594:0:5817:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000f2517418) 00000020:00000080:1.0:1787779428.957605:0:5817:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1787779428.957922:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cb634764 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c28aae66-2825-42c5-8f52-61f687e868c9:3303:1874622524948608:0@lo:250: 00000100:00100000:2.0:1787779428.958014:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779428.958105:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524948608 00000100:00100000:2.0:1787779428.958190:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524948608 00000100:00100000:2.0:1787779428.958811:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787779428.958821:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e54b31fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3303:x1874622524948608:12345-0@lo:250: 00010000:00080000:2.0:1787779428.958845:0:5828:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from c28aae66-2825-42c5-8f52-61f687e868c9@0@lo t0 exp 0000000000000000 cur 194 last 0 00000020:00000080:2.0:1787779428.958870:0:5828:0:(genops.c:1385:class_connect()) connect: client c28aae66-2825-42c5-8f52-61f687e868c9, cookie 0x9e63ba8af6888c73 00000100:00080000:2.0:1787779428.958998:0:5828:0:(import.c:65:import_set_state_nolock()) 0000000092b9164a : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787779428.959064:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e54b31fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+5:3303:x1874622524948608:12345-0@lo:250: Request processed in 244us (1051us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779428.959072:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787779428.961383:0:3303:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.201.109@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1787779428.961406:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.109@tcp: connect to target with instance 0 00000100:00080000:2.0:1787779428.961416:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.109@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1787779428.961422:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1787779428.961426:0:3303:0:(import.c:65:import_set_state_nolock()) 00000000b23c3478 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1787779428.961430:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1787779428.961446:0:3303:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1787779428.961453:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cb634764 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c28aae66-2825-42c5-8f52-61f687e868c9:3303:1874622524948608:0@lo:250: 00000100:00100000:1.0:1787779428.980672:0:5817:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787779428.983005:0:5817:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1787779428.983013:0:5817:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1787779428.987055:0:5817:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1787779428.987080:0:5817:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1787779428.988089:0:5817:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1787779428.988099:0:5817:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1787779428.989516:0:5817:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787779428.989698:0:5817:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1787779428.989704:0:5817:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1787779428.991380:0:5817:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1787779428.991393:0:5817:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1787779429.044171:0:5817:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787779429.044559:0:5817:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1787779429.044566:0:5817:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1787779429.048891:0:5817:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1787779429.048915:0:5817:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1787779429.052010:0:5817:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787779429.052573:0:5817:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787779429.052581:0:5817:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1787779429.059085:0:5817:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787779429.059172:0:5817:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1787779429.059954:0:5817:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787779429.060317:0:5817:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787779429.060324:0:5817:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1787779429.061208:0:5817:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787779429.061217:0:5817:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1787779429.064614:0:5817:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787779429.064864:0:5817:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787779429.064871:0:5817:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1787779429.065805:0:5817:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787779429.065814:0:5817:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1787779429.119458:0:5817:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787779429.127544:0:5817:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787779429.127554:0:5817:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1787779429.130121:0:5817:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787779429.130146:0:5817:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1787779429.132075:0:5817:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787779429.132087:0:5817:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1787779429.136226:0:5817:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1787779429.136432:0:5817:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1787779429.136439:0:5817:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.109@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1787779429.136601:0:5817:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.109@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787779429.136641:0:5817:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.109@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1787779429.136646:0:5817:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787779429.136648:0:5817:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787779429.136649:0:5817:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787779429.136650:0:5817:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787779429.136651:0:5817:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787779429.136652:0:5817:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787779429.136653:0:5817:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787779429.136655:0:5817:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787779429.136656:0:5817:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787779429.136657:0:5817:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787779429.136664:0:5817:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787779429.136665:0:5817:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787779429.136667:0:5817:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1787779429.136669:0:5817:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787779429.136670:0:5817:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787779429.136671:0:5817:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787779429.136672:0:5817:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787779429.136672:0:5817:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787779429.136673:0:5817:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787779429.136674:0:5817:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787779429.136675:0:5817:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787779429.136676:0:5817:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787779429.136677:0:5817:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787779429.136677:0:5817:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787779429.136678:0:5817:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787779429.136894:0:5817:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787779429.136983:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004ab8d965 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:5817:1874622524948736:0@lo:253: 00000100:00100000:3.0:1787779429.137061:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779429.137167:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ddf2f17f going to sleep for 11 seconds 00000100:00100000:1.0:1787779429.137487:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524948736 00000100:00100000:1.0:1787779429.137494:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524948736 00000100:00100000:1.0:1787779429.137596:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787779429.137605:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000059d4c0a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+5:5817:x1874622524948736:12345-0@lo:253: 20000000:01000000:1.0:1787779429.137652:0:5831:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787779429.137655:0:5831:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1787779429.138189:0:5851:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1787779429.138585:0:5831:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1787779429.139008:0:5831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787779429.141653:0:5852:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1787779429.142216:0:5831:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787779429.142222:0:5831:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1787779429.142230:0:5831:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1787779429.142234:0:5831:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1787779429.142339:0:5831:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1787779429.142617:0:5831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787779429.143327:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1787779429.143344:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787779429.143410:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1787779429.143462:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1787779429.143501:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1787779429.143611:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1787779429.143620:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1787779429.143679:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1787779429.143689:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1787779429.143989:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1787779429.143999:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1787779429.144032:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1787779429.144083:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1787779429.144203:0:5831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1787779429.144211:0:5831:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1787779429.144224:0:5831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787779429.144508:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1787779429.144519:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1787779429.144553:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1787779429.144584:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1787779429.144642:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1787779429.144655:0:5831:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1787779429.145332:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1787779429.145347:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1787779429.145410:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1787779429.145451:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1787779429.145485:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1787779429.145500:0:5831:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1787779429.145623:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1787779429.145634:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1787779429.145666:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1787779429.145700:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1787779429.149086:0:5831:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1787779429.149229:0:5831:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1787779429.149378:0:5831:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1787779429.150389:0:5853:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1787779429.151033:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1787779429.151062:0:5831:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.201.109@tcp for mdt 20000000:01000000:0.0:1787779429.151064:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.109@tcp (null) (null) (null) 00000040:00080000:0.0:1787779429.151130:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1787779429.151138:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1787779429.151168:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1787779429.151175:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.201.109@tcp (null) (null) 00000040:00080000:0.0:1787779429.151217:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1787779429.151227:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1787779429.151293:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1787779429.151330:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1787779429.151403:0:5831:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1787779429.151406:0:5831:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1787779429.151410:0:5831:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1787779429.151439:0:5831:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787779429.151442:0:5831:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1787779429.151474:0:5831:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787779429.151476:0:5831:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787779429.155155:0:5854:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1787779429.155654:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1787779429.155706:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1787779429.155776:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:1.0:1787779429.155792:0:5831:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787779429.155795:0:5831:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787779429.158485:0:5855:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:1.0:1787779429.159072:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1787779429.159135:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:1.0:1787779429.159220:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:1.0:1787779429.159486:0:5831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787779429.159490:0:5831:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:1.0:1787779429.159495:0:5831:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1787779429.159498:0:5831:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1787779429.159515:0:5831:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1787779429.159522:0:5831:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1787779429.160450:0:5856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:2.0:1787779429.160591:0:5831:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1787779429.180885:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:2.0:1787779429.181090:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:2.0:1787779429.183842:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:2.0:1787779429.183891:0:5831:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787779429.183915:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000f283d3ba/0x9e63ba8af6888c7a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779429.183934:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f283d3ba/0x9e63ba8af6888c7a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779429.183944:0:5831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f283d3ba/0x9e63ba8af6888c7a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779429.183950:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f283d3ba/0x9e63ba8af6888c7a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779429.183956:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000f283d3ba/0x9e63ba8af6888c7a lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779429.183963:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000f283d3ba/0x9e63ba8af6888c7a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779429.183988:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f283d3ba already unused, calling callback (0000000061448218) 00010000:00010000:2.0:1787779429.183992:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000f283d3ba/0x9e63ba8af6888c7a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779429.184000:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000f283d3ba/0x9e63ba8af6888c7a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779429.184012:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000f283d3ba/0x9e63ba8af6888c7a lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779429.184018:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000f283d3ba/0x9e63ba8af6888c7a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779429.184023:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f283d3ba/0x9e63ba8af6888c7a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787779429.184053:0:5831:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1787779429.496035:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000059d4c0a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+5:5817:x1874622524948736:12345-0@lo:253: Request processed in 358424us (358967us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779429.496058:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787779429.496148:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004ab8d965 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:5817:1874622524948736:0@lo:253: 10000000:01000000:2.0:1787779429.496164:0:5817:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787779429.496167:0:5817:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787779429.496169:0:5817:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787779429.496170:0:5817:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787779429.496172:0:5817:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1787779429.496173:0:5817:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787779429.496175:0:5817:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787779429.496176:0:5817:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787779429.496177:0:5817:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787779429.496179:0:5817:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787779429.496180:0:5817:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787779429.496182:0:5817:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787779429.496201:0:5817:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000d9049ba2 from lustre-MDT0000 10000000:01000000:2.0:1787779429.496368:0:5817:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1787779429.496385:0:5817:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787779429.496390:0:5817:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff98e842f18000 10000000:01000000:2.0:1787779429.496395:0:5817:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787779429.496402:0:5817:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff98e842f18000 from 1 10000000:01000000:2.0:1787779429.496405:0:5817:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787779429.496443:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: 00000000f283d3ba/0x9e63ba8af6888c81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779429.496454:0:5817:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: 00000000f283d3ba/0x9e63ba8af6888c81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779429.496462:0:5817:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: 00000000f283d3ba/0x9e63ba8af6888c81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779429.496481:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000af314f23 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:5817:1874622524948864:0@lo:101: 00000100:00100000:2.0:1787779429.496518:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779429.496618:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set 00000000765f20d5 going to sleep for 11 seconds 00000100:00100000:1.0:1787779429.496870:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524948864 00000100:00100000:1.0:1787779429.496877:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524948864 00000100:00100000:1.0:1787779429.496958:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787779429.496968:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000067473cae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+5:5817:x1874622524948864:12345-0@lo:101: 00010000:00010000:1.0:1787779429.496981:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779429.496995:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000023b4198c/0x9e63ba8af6888c88 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9e63ba8af6888c81 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779429.497017:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000023b4198c/0x9e63ba8af6888c88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9e63ba8af6888c81 expref: 6 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779429.497026:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000023b4198c/0x9e63ba8af6888c88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af6888c81 expref: 6 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779429.497035:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000023b4198c, rc 0) 00000100:00100000:1.0:1787779429.497102:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000067473cae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+6:5817:x1874622524948864:12345-0@lo:101: Request processed in 137us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779429.497109:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787779429.497181:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000af314f23 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:5817:1874622524948864:0@lo:101: 00010000:00010000:3.0:1787779429.497193:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: 00000000f283d3ba/0x9e63ba8af6888c81 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888c88 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779429.497202:0:5817:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: 00000000f283d3ba/0x9e63ba8af6888c81 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9e63ba8af6888c88 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779429.497271:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001f9d4aba pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:5817:1874622524948992:0@lo:501: 00000100:00100000:3.0:1787779429.497318:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779429.497514:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ef26bbd0 going to sleep for 11 seconds 00000100:00100000:2.0:1787779429.497583:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524948992 00000100:00100000:2.0:1787779429.497587:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524948992 00000100:00100000:2.0:1787779429.497611:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787779429.497617:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004ce49fe7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+6:5817:x1874622524948992:12345-0@lo:501: 00000100:00100000:2.0:1787779429.497937:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004ce49fe7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+6:5817:x1874622524948992:12345-0@lo:501: Request processed in 320us (618us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787779429.497945:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787779429.498051:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001f9d4aba pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:5817:1874622524948992:0@lo:501: 10000000:01000000:3.0:1787779429.498079:0:5817:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787779429.498134:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: 00000000f283d3ba/0x9e63ba8af6888c81 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888c88 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779429.498143:0:5817:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: 00000000f283d3ba/0x9e63ba8af6888c81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888c88 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787779429.498151:0:5817:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98e846b05800 10000000:01000000:3.0:1787779429.498156:0:5817:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787779429.498161:0:5817:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff98e846b05800 10000000:01000000:3.0:1787779429.498164:0:5817:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1787779429.498166:0:5817:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff98e846b05800 from 1 10000000:01000000:3.0:1787779429.498169:0:5817:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1787779429.498194:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: 0000000022dcc32c/0x9e63ba8af6888c8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779429.498201:0:5817:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: 0000000022dcc32c/0x9e63ba8af6888c8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779429.498209:0:5817:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: 0000000022dcc32c/0x9e63ba8af6888c8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779429.498369:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001f9d4aba pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:5817:1874622524949120:0@lo:101: 00000100:00100000:3.0:1787779429.498404:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779429.498436:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ef26bbd0 going to sleep for 11 seconds 00000100:00100000:2.0:1787779429.498496:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524949120 00000100:00100000:2.0:1787779429.498502:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524949120 00000100:00100000:2.0:1787779429.498539:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787779429.498546:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008ac6bc8a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+6:5817:x1874622524949120:12345-0@lo:101: 00010000:00010000:2.0:1787779429.498556:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779429.498578:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000228e2a57/0x9e63ba8af6888c96 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9e63ba8af6888c8f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779429.498596:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000228e2a57/0x9e63ba8af6888c96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9e63ba8af6888c8f expref: 7 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779429.498606:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000228e2a57/0x9e63ba8af6888c96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af6888c8f expref: 7 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779429.498614:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000228e2a57, rc 0) 00000100:00100000:2.0:1787779429.498643:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008ac6bc8a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+7:5817:x1874622524949120:12345-0@lo:101: Request processed in 99us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779429.498649:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787779429.498755:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001f9d4aba pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:5817:1874622524949120:0@lo:101: 00010000:00010000:3.0:1787779429.498775:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: 0000000022dcc32c/0x9e63ba8af6888c8f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888c96 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779429.498782:0:5817:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: 0000000022dcc32c/0x9e63ba8af6888c8f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9e63ba8af6888c96 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787779429.498793:0:5817:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1787779429.498974:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: 0000000022dcc32c/0x9e63ba8af6888c8f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888c96 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779429.498983:0:5817:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: 0000000022dcc32c/0x9e63ba8af6888c8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888c96 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787779429.498988:0:5817:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787779429.498992:0:5817:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787779429.498996:0:5817:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff98e846b05800 10000000:01000000:3.0:1787779429.498999:0:5817:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1787779429.499002:0:5817:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1787779429.499004:0:5817:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787779429.499019:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: 000000002cb66e7f/0x9e63ba8af6888c9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779429.499026:0:5817:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: 000000002cb66e7f/0x9e63ba8af6888c9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779429.499032:0:5817:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: 000000002cb66e7f/0x9e63ba8af6888c9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779429.499043:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001f9d4aba pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:5817:1874622524949248:0@lo:101: 00000100:00100000:3.0:1787779429.499071:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779429.499104:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ef26bbd0 going to sleep for 11 seconds 00000100:00100000:2.0:1787779429.499154:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524949248 00000100:00100000:2.0:1787779429.499158:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524949248 00000100:00100000:2.0:1787779429.499189:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787779429.499195:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004f0a9fea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+7:5817:x1874622524949248:12345-0@lo:101: 00010000:00010000:2.0:1787779429.499201:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779429.499210:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001d076035/0x9e63ba8af6888ca4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9e63ba8af6888c9d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779429.499367:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001d076035/0x9e63ba8af6888ca4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9e63ba8af6888c9d expref: 8 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779429.499377:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001d076035/0x9e63ba8af6888ca4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af6888c9d expref: 8 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779429.499384:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001d076035, rc 0) 00000100:00100000:2.0:1787779429.499426:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004f0a9fea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+8:5817:x1874622524949248:12345-0@lo:101: Request processed in 232us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779429.499442:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787779429.499522:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001f9d4aba pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:5817:1874622524949248:0@lo:101: 00010000:00010000:0.0:1787779429.499533:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: 000000002cb66e7f/0x9e63ba8af6888c9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888ca4 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779429.499539:0:5817:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: 000000002cb66e7f/0x9e63ba8af6888c9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9e63ba8af6888ca4 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779429.499581:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d4d9057b pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:5817:1874622524949376:0@lo:501: 00000100:00100000:0.0:1787779429.499622:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779429.499645:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set 00000000753b1c2b going to sleep for 11 seconds 00000100:00100000:2.0:1787779429.499697:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524949376 00000100:00100000:2.0:1787779429.499702:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524949376 00000100:00100000:2.0:1787779429.499749:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787779429.499755:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c604b97d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+8:5817:x1874622524949376:12345-0@lo:501: 00000100:00100000:2.0:1787779429.499982:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c604b97d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+9:5817:x1874622524949376:12345-0@lo:501: Request processed in 224us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779429.499989:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787779429.500073:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d4d9057b pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:5817:1874622524949376:0@lo:501: 00000100:00100000:0.0:1787779429.500113:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d4d9057b pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:5817:1874622524949504:0@lo:503: 00000100:00100000:0.0:1787779429.500149:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779429.500177:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set 00000000753b1c2b going to sleep for 11 seconds 00000100:00100000:2.0:1787779429.500384:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524949504 00000100:00100000:2.0:1787779429.500388:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524949504 00000100:00100000:2.0:1787779429.500421:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787779429.500427:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000086f537c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+9:5817:x1874622524949504:12345-0@lo:503: 00000100:00100000:2.0:1787779429.500579:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000086f537c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+9:5817:x1874622524949504:12345-0@lo:503: Request processed in 152us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779429.500586:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787779429.500625:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d4d9057b pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:5817:1874622524949504:0@lo:503: 00000100:00100000:3.0:1787779429.501177:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000216ada8d pname:cluuid:pid:xid:nid:opc:job llog_process_th:c28aae66-2825-42c5-8f52-61f687e868c9:5858:1874622524949632:0@lo:502: 00000100:00100000:3.0:1787779429.501368:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779429.501443:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set 00000000356a214a going to sleep for 11 seconds 00000100:00100000:2.0:1787779429.501482:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524949632 00000100:00100000:2.0:1787779429.501487:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524949632 00000100:00100000:2.0:1787779429.501554:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787779429.501562:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c3b7dfca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+9:5858:x1874622524949632:12345-0@lo:502: 00000100:00100000:2.0:1787779429.501819:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c3b7dfca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+9:5858:x1874622524949632:12345-0@lo:502: Request processed in 259us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779429.501827:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787779429.501898:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000216ada8d pname:cluuid:pid:xid:nid:opc:job llog_process_th:c28aae66-2825-42c5-8f52-61f687e868c9:5858:1874622524949632:0@lo:502: 00000020:01000000:3.0:1787779429.501924:0:5858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787779429.501934:0:5858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787779429.501936:0:5858:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787779429.501941:0:5858:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1787779429.501943:0:5858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787779429.501965:0:5858:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000007b39df3d) 00000020:00000080:3.0:1787779429.501983:0:5858:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1787779429.501989:0:5858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1787779429.502116:0:5858:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:3.0:1787779429.502125:0:5858:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9e63ba8af6888cb2 00000020:00000080:3.0:1787779429.502493:0:5858:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1787779429.502498:0:5858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787779429.502502:0:5858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787779429.502504:0:5858:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787779429.502507:0:5858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787779429.502511:0:5858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787779429.502513:0:5858:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1787779429.502516:0:5858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787779429.502522:0:5858:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (0000000030a40a9c) 00000020:00000080:3.0:1787779429.502532:0:5858:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1787779429.502536:0:5858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1787779429.502538:0:5858:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1787779429.502541:0:5858:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1787779429.502548:0:5858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787779429.502595:0:5858:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000d9049ba2 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1787779429.502606:0:5858:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000cdf2e6da) 00000020:00000080:3.0:1787779429.502614:0:5858:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1787779429.502667:0:5858:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1787779429.502674:0:5858:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9e63ba8af6888cc7 00000020:00000080:3.0:1787779429.502878:0:5858:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1787779429.502885:0:5858:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1787779429.502891:0:5858:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x9e63ba8af6888cce 00080000:01000000:3.0:1787779429.502896:0:5858:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:3.0:1787779429.502900:0:5858:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9e63ba8af6888cd5 00080000:10000000:3.0:1787779429.503384:0:5858:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1787779429.503573:0:5858:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1787779429.508149:0:5858:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:1.0:1787779429.580191:0:5858:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:1.0:1787779429.580672:0:5858:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:0.0:1787779429.582827:0:5858:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1787779429.583141:0:5858:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1787779429.624034:0:5858:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000f195dd30) 00000020:00000080:0.0:1787779429.624063:0:5858:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1787779429.624149:0:5858:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:0.0:1787779429.624155:0:5858:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9e63ba8af6888ce3 00000020:00000080:0.0:1787779429.628584:0:5858:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:0.0:1787779429.633502:0:5858:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:0.0:1787779429.682898:0:5858:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1787779429.734657:0:5858:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1787779429.775619:0:5858:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:0.0:1787779429.828393:0:5858:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:0.0:1787779429.872466:0:5858:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:1.0:1787779429.913147:0:5858:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x9e63ba8af6888cea 00000020:00000080:1.0:1787779429.913611:0:5858:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1787779429.913623:0:5858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787779429.913629:0:5858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787779429.913632:0:5858:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1787779429.913636:0:5858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787779429.913640:0:5858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787779429.913646:0:5858:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787779429.913650:0:5858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787779429.913652:0:5858:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787779429.913654:0:5858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787779429.913656:0:5858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787779429.913657:0:5858:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787779429.913659:0:5858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787779429.913664:0:5858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787779429.913665:0:5858:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1787779429.913669:0:5858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1787779429.913709:0:5858:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:1.0:1787779429.913796:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004c2be8f8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c28aae66-2825-42c5-8f52-61f687e868c9:5858:1874622524949760:0@lo:502: 00000100:00100000:1.0:1787779429.913871:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779429.913968:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set 0000000076b30528 going to sleep for 11 seconds 00000100:00100000:3.0:1787779429.914091:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524949760 00000100:00100000:3.0:1787779429.914098:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524949760 00000100:00100000:3.0:1787779429.914135:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787779429.914143:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d34dba44 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+9:5858:x1874622524949760:12345-0@lo:502: 00000100:00100000:3.0:1787779429.914473:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d34dba44 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+9:5858:x1874622524949760:12345-0@lo:502: Request processed in 331us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779429.914482:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787779429.914647:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004c2be8f8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c28aae66-2825-42c5-8f52-61f687e868c9:5858:1874622524949760:0@lo:502: 00000020:01000000:1.0:1787779429.914674:0:5858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787779429.914679:0:5858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787779429.914681:0:5858:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:1.0:1787779429.914685:0:5858:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1787779429.914935:0:5817:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1787779429.914966:0:5817:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787779429.914984:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: 000000002cb66e7f/0x9e63ba8af6888c9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888ca4 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779429.914996:0:5817:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: 000000002cb66e7f/0x9e63ba8af6888c9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888ca4 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787779429.915004:0:5817:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98e846b05800 from 1 10000000:01000000:3.0:1787779429.915007:0:5817:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787779429.915034:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: 00000000dfd74766/0x9e63ba8af6888cf1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779429.915053:0:5817:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: 00000000dfd74766/0x9e63ba8af6888cf1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779429.915062:0:5817:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: 00000000dfd74766/0x9e63ba8af6888cf1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779429.915077:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000216ada8d pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:5817:1874622524949888:0@lo:101: 00000100:00100000:3.0:1787779429.915111:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779429.915485:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524949888 00000100:00100000:0.0:1787779429.915491:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524949888 00000100:00100000:0.0:1787779429.915521:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787779429.915528:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000289421dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+9:5817:x1874622524949888:12345-0@lo:101: 00010000:00010000:0.0:1787779429.915539:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787779429.915553:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009b5ce470/0x9e63ba8af6888cf8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9e63ba8af6888cf1 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779429.915572:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009b5ce470/0x9e63ba8af6888cf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9e63ba8af6888cf1 expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779429.915580:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009b5ce470/0x9e63ba8af6888cf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af6888cf1 expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779429.915598:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009b5ce470, rc 0) 00000100:00100000:0.0:1787779429.915627:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000289421dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+10:5817:x1874622524949888:12345-0@lo:101: Request processed in 99us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779429.915633:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787779429.915994:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set 00000000dabc0ca9 going to sleep for 11 seconds 00000100:00100000:3.0:1787779429.916017:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000216ada8d pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:5817:1874622524949888:0@lo:101: 00010000:00010000:3.0:1787779429.916033:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: 00000000dfd74766/0x9e63ba8af6888cf1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888cf8 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779429.916041:0:5817:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: 00000000dfd74766/0x9e63ba8af6888cf1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9e63ba8af6888cf8 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779429.917106:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000216ada8d pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:5817:1874622524950016:0@lo:256: 00000100:00100000:3.0:1787779429.917174:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779429.917330:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set 00000000dabc0ca9 going to sleep for 11 seconds 00000100:00100000:0.0:1787779429.917380:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524950016 00000100:00100000:0.0:1787779429.917386:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524950016 00000100:00100000:0.0:1787779429.917460:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787779429.917468:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f652ed32 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+10:5817:x1874622524950016:12345-0@lo:256: 20000000:01000000:0.0:1787779429.917487:0:5828:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1787779429.917492:0:5828:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1787779429.917656:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f652ed32 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+10:5817:x1874622524950016:12345-0@lo:256: Request processed in 189us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779429.917663:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787779429.917859:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000216ada8d pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:5817:1874622524950016:0@lo:256: 10000000:01000000:2.0:1787779429.918493:0:5817:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787779429.918557:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: 00000000dfd74766/0x9e63ba8af6888cf1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888cf8 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779429.918567:0:5817:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: 00000000dfd74766/0x9e63ba8af6888cf1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888cf8 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787779429.918574:0:5817:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98e846b05800 from 1 10000000:01000000:2.0:1787779429.918576:0:5817:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787779429.918608:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: 00000000c580c7b3/0x9e63ba8af6888cff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779429.918615:0:5817:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: 00000000c580c7b3/0x9e63ba8af6888cff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779429.918623:0:5817:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: 00000000c580c7b3/0x9e63ba8af6888cff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779429.918640:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c90cd9fe pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:5817:1874622524950144:0@lo:101: 00000100:00100000:2.0:1787779429.918686:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779429.918760:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set 00000000eef43aaf going to sleep for 11 seconds 00000100:00100000:3.0:1787779429.918894:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524950144 00000100:00100000:3.0:1787779429.918901:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524950144 00000100:00100000:3.0:1787779429.918943:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787779429.918950:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000036a9bfcd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+10:5817:x1874622524950144:12345-0@lo:101: 00010000:00010000:3.0:1787779429.918962:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779429.918978:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000038d1f7b6/0x9e63ba8af6888d06 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9e63ba8af6888cff expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779429.919010:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000038d1f7b6/0x9e63ba8af6888d06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9e63ba8af6888cff expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779429.919018:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000038d1f7b6/0x9e63ba8af6888d06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af6888cff expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779429.919025:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000038d1f7b6, rc 0) 00000100:00100000:3.0:1787779429.919062:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000036a9bfcd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+11:5817:x1874622524950144:12345-0@lo:101: Request processed in 112us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779429.919068:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787779429.919109:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c90cd9fe pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:5817:1874622524950144:0@lo:101: 00010000:00010000:3.0:1787779429.919120:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: 00000000c580c7b3/0x9e63ba8af6888cff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888d06 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779429.919127:0:5817:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: 00000000c580c7b3/0x9e63ba8af6888cff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9e63ba8af6888d06 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779429.919176:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000098f27d6e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:5817:1874622524950272:0@lo:501: 00000100:00100000:3.0:1787779429.919198:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779429.919228:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set 000000003a83babd going to sleep for 11 seconds 00000100:00100000:3.0:1787779429.919240:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524950272 00000100:00100000:3.0:1787779429.919243:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524950272 00000100:00100000:3.0:1787779429.919257:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787779429.919262:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b49a3d9d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+11:5817:x1874622524950272:12345-0@lo:501: 00000100:00100000:3.0:1787779429.919943:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b49a3d9d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+11:5817:x1874622524950272:12345-0@lo:501: Request processed in 680us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779429.919952:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787779429.920031:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000098f27d6e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:5817:1874622524950272:0@lo:501: 00000100:00100000:3.0:1787779429.920061:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000098f27d6e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:5817:1874622524950400:0@lo:503: 00000100:00100000:3.0:1787779429.920099:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779429.920114:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set 000000003a83babd going to sleep for 11 seconds 00000100:00100000:3.0:1787779429.920127:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524950400 00000100:00100000:3.0:1787779429.920130:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524950400 00000100:00100000:3.0:1787779429.920148:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787779429.920153:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c13eaa3a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+11:5817:x1874622524950400:12345-0@lo:503: 00000040:00080000:3.0:1787779429.920182:0:5831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787779429.920211:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c13eaa3a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+11:5817:x1874622524950400:12345-0@lo:503: Request processed in 59us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779429.920217:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787779429.920247:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000098f27d6e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:5817:1874622524950400:0@lo:503: 00000040:00080000:3.0:1787779429.921472:0:5862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1787779429.921925:0:5817:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1787779429.921943:0:5817:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787779429.921993:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: 00000000c580c7b3/0x9e63ba8af6888cff lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888d06 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779429.922005:0:5817:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: 00000000c580c7b3/0x9e63ba8af6888cff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888d06 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787779429.922058:0:5817:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787779429.922061:0:5817:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98e846b05800 10000000:01000000:0.0:1787779429.922064:0:5817:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98e846b05800 10000000:01000000:0.0:1787779429.922067:0:5817:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787779429.922073:0:5817:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98e846b05800 from 1 10000000:01000000:0.0:1787779429.922076:0:5817:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787779429.922112:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: 000000003ed8bd68/0x9e63ba8af6888d0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779429.922132:0:5817:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: 000000003ed8bd68/0x9e63ba8af6888d0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779429.922141:0:5817:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: 000000003ed8bd68/0x9e63ba8af6888d0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779429.922162:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000176f775a pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:5817:1874622524950528:0@lo:101: 00000100:00100000:0.0:1787779429.922229:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779429.922262:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set 00000000da5a41f1 going to sleep for 11 seconds 00000100:00100000:3.0:1787779429.922378:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524950528 00000100:00100000:3.0:1787779429.922385:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524950528 00000100:00100000:3.0:1787779429.922428:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787779429.922435:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000790212ff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+11:5817:x1874622524950528:12345-0@lo:101: 00010000:00010000:3.0:1787779429.922447:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779429.922461:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002602e714/0x9e63ba8af6888d14 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9e63ba8af6888d0d expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779429.922481:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002602e714/0x9e63ba8af6888d14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9e63ba8af6888d0d expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779429.922490:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002602e714/0x9e63ba8af6888d14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af6888d0d expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779429.922507:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002602e714, rc 0) 00000100:00100000:3.0:1787779429.922553:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000790212ff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+12:5817:x1874622524950528:12345-0@lo:101: Request processed in 118us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779429.922559:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787779429.922638:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000176f775a pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:5817:1874622524950528:0@lo:101: 00010000:00010000:2.0:1787779429.922651:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: 000000003ed8bd68/0x9e63ba8af6888d0d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888d14 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779429.922658:0:5817:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: 000000003ed8bd68/0x9e63ba8af6888d0d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9e63ba8af6888d14 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779429.922745:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005037706f pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:5817:1874622524950656:0@lo:501: 00000100:00100000:2.0:1787779429.922774:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779429.922800:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set 00000000eef43aaf going to sleep for 11 seconds 00000100:00100000:3.0:1787779429.922926:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524950656 00000100:00100000:3.0:1787779429.922930:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524950656 00000100:00100000:3.0:1787779429.922960:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787779429.922967:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cd77be1e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+12:5817:x1874622524950656:12345-0@lo:501: 00000100:00100000:3.0:1787779429.923200:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cd77be1e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+12:5817:x1874622524950656:12345-0@lo:501: Request processed in 233us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779429.923223:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787779429.923369:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005037706f pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:5817:1874622524950656:0@lo:501: 00000100:00100000:2.0:1787779429.923399:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005037706f pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:5817:1874622524950784:0@lo:503: 00000100:00100000:2.0:1787779429.923438:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779429.923464:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set 00000000eef43aaf going to sleep for 11 seconds 00000100:00100000:0.0:1787779429.923522:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524950784 00000100:00100000:0.0:1787779429.923525:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524950784 00000100:00100000:0.0:1787779429.923553:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787779429.923558:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000082451a1f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+12:5817:x1874622524950784:12345-0@lo:503: 00000100:00100000:0.0:1787779429.924096:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000082451a1f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+12:5817:x1874622524950784:12345-0@lo:503: Request processed in 536us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779429.924105:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787779429.924305:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005037706f pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:5817:1874622524950784:0@lo:503: 00000100:00100000:1.0:1787779429.924609:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004c2be8f8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c28aae66-2825-42c5-8f52-61f687e868c9:5863:1874622524950912:0@lo:502: 00000100:00100000:1.0:1787779429.924650:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779429.928641:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set 000000008292afcb going to sleep for 11 seconds 00000100:00100000:2.0:1787779429.929014:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524950912 00000100:00100000:2.0:1787779429.929024:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524950912 00000100:00100000:3.0:1787779429.929411:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787779429.929421:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000773a2b22 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+12:5863:x1874622524950912:12345-0@lo:502: 00000100:00100000:3.0:1787779429.931483:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000773a2b22 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+12:5863:x1874622524950912:12345-0@lo:502: Request processed in 2057us (6826us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779429.931499:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787779429.931654:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004c2be8f8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c28aae66-2825-42c5-8f52-61f687e868c9:5863:1874622524950912:0@lo:502: 00000020:01000004:1.0:1787779429.931802:0:5863:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1787779429.931819:0:5863:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000006e49a832) 00000020:00000080:1.0:1787779429.931841:0:5863:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1787779429.931943:0:5863:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000d9049ba2 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787779429.931948:0:5863:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000d9049ba2 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787779429.931950:0:5863:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000d9049ba2 4 00010000:00080000:1.0:1787779429.931990:0:5863:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000c509af7d@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.109@tcp at head 00010000:00010000:1.0:1787779429.933657:0:5863:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1787779429.933912:0:5863:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1787779429.933952:0:5863:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787779429.933966:0:5863:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x9e63ba8af6888d22 00000100:00080000:1.0:1787779429.933977:0:5863:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787779429.933981:0:5863:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000c509af7d using connection 192.168.201.109@tcp/0@lo 00000100:00100000:1.0:1787779429.934023:0:5863:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000004c2be8f8 x1874622524951040/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787779429.934067:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004c2be8f8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874622524951040:0@lo:38: 00000100:00100000:1.0:1787779429.934135:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779429.934209:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524951040 00000100:00100000:1.0:1787779429.934216:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524951040 00000100:00100000:1.0:1787779429.934244:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787779429.934249:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c571d454 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1874622524951040:12345-0@lo:38: 00000100:00100000:1.0:1787779429.934313:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c571d454 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1874622524951040:12345-0@lo:38: Request processed in 63us (178us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787779429.934320:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787779429.934358:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787779429.934366:0:3303:0:(import.c:65:import_set_state_nolock()) 00000000c509af7d lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787779429.934382:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787779429.934385:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004c2be8f8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874622524951040:0@lo:38: 00000100:00080000:1.0:1787779429.934419:0:5863:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787779429.940614:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000098f27d6e pname:cluuid:pid:xid:nid:opc:job llog_process_th:c28aae66-2825-42c5-8f52-61f687e868c9:5863:1874622524951168:0@lo:502: 00010000:00010000:2.0:1787779429.940843:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779429.941493:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779429.941555:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set 000000008efa2897 going to sleep for 11 seconds 00000100:00100000:3.0:1787779429.941584:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524951168 00000100:00100000:3.0:1787779429.941591:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524951168 00000100:00100000:3.0:1787779429.941636:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787779429.941645:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c1dca59e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+12:5863:x1874622524951168:12345-0@lo:502: 00000100:00100000:3.0:1787779429.943656:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c1dca59e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+12:5863:x1874622524951168:12345-0@lo:502: Request processed in 2003us (2157us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779429.943689:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787779429.944894:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000098f27d6e pname:cluuid:pid:xid:nid:opc:job llog_process_th:c28aae66-2825-42c5-8f52-61f687e868c9:5863:1874622524951168:0@lo:502: 00000040:00080000:0.0:1787779429.944943:0:5863:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1787779429.945836:0:5817:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1787779429.945867:0:5817:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787779429.945891:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: 000000003ed8bd68/0x9e63ba8af6888d0d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888d14 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779429.945905:0:5817:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: 000000003ed8bd68/0x9e63ba8af6888d0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888d14 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787779429.945962:0:5817:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787779429.945965:0:5817:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787779429.945966:0:5817:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787779429.945967:0:5817:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787779429.945968:0:5817:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787779429.945970:0:5817:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787779429.945971:0:5817:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787779429.945972:0:5817:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787779429.945974:0:5817:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787779429.945975:0:5817:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787779429.945976:0:5817:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787779429.945978:0:5817:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787779429.945982:0:5817:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1787779429.945985:0:5817:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787779429.945986:0:5817:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787779429.945992:0:5817:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787779429.945993:0:5817:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787779429.945994:0:5817:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787779429.945995:0:5817:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787779429.945996:0:5817:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787779429.945997:0:5817:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787779429.945998:0:5817:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787779429.945998:0:5817:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787779429.945999:0:5817:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787779429.946000:0:5817:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787779429.946027:0:5817:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787779429.946045:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005037706f pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:5817:1874622524951296:0@lo:253: 00000100:00100000:2.0:1787779429.946109:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779429.946148:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set 00000000eef43aaf going to sleep for 11 seconds 00000100:00100000:3.0:1787779429.946334:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524951296 00000100:00100000:3.0:1787779429.946342:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524951296 00000100:00100000:3.0:1787779429.946396:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787779429.946405:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005ff55c0d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+12:5817:x1874622524951296:12345-0@lo:253: 20000000:01000000:3.0:1787779429.946434:0:5828:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787779429.946447:0:5828:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787779430.011845:0:5828:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787779430.011860:0:5828:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1787779430.012389:0:5851:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787779430.012395:0:5851:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787779430.012417:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000110a53d4/0x9e63ba8af6888d29 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779430.012461:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000009b5ce470/0x9e63ba8af6888cf8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af6888cf1 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779430.012469:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000110a53d4/0x9e63ba8af6888d29 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779430.012507:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000009b5ce470/0x9e63ba8af6888cf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9e63ba8af6888cf1 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779430.012520:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000009b5ce470/0x9e63ba8af6888cf8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9e63ba8af6888cf1 expref: 12 pid: 5828 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779430.012534:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004c2be8f8 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5851:1874622524951424:0@lo:104: 00000100:00100000:1.0:1787779430.012605:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779430.012658:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set 000000002387f1d6 going to sleep for 11 seconds 00000100:00100000:3.0:1787779430.012874:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524951424 00000100:00100000:3.0:1787779430.012882:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524951424 00000100:00100000:3.0:1787779430.012969:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787779430.012979:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e17baa67 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c28aae66-2825-42c5-8f52-61f687e868c9+3:5851:x1874622524951424:12345-0@lo:104: 00010000:00010000:3.0:1787779430.012991:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.109@tcp lock: 00000000dfd74766/0x9e63ba8af6888cf1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9e63ba8af6888cf8 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779430.013044:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787779430.013049:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e17baa67 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c28aae66-2825-42c5-8f52-61f687e868c9+3:5851:x1874622524951424:12345-0@lo:104: Request processed in 73us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779430.013056:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1787779430.013131:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787779430.013136:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: 00000000dfd74766/0x9e63ba8af6888cf1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9e63ba8af6888cf8 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779430.013143:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000dfd74766 already unused, calling callback (000000001eabe820) 10000000:00010000:1.0:1787779430.013145:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: 00000000dfd74766/0x9e63ba8af6888cf1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9e63ba8af6888cf8 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779430.013152:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: 00000000dfd74766/0x9e63ba8af6888cf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9e63ba8af6888cf8 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787779430.013159:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: 00000000dfd74766/0x9e63ba8af6888cf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9e63ba8af6888cf8 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787779430.013176:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787779430.013227:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.109@tcp lock: 00000000dfd74766/0x9e63ba8af6888cf1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af6888cf8 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779430.013234:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787779430.013252:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: 00000000dfd74766/0x9e63ba8af6888cf1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af6888cf8 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779430.013259:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: 00000000dfd74766/0x9e63ba8af6888cf1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af6888cf8 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779430.013286:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779430.013288:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779430.013289:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779430.013370:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006440c6c1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c28aae66-2825-42c5-8f52-61f687e868c9:3305:1874622524951552:0@lo:103: 00000100:00100000:1.0:1787779430.013403:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779430.013511:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524951552 00000100:00100000:1.0:1787779430.013516:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524951552 00010000:00010000:1.0:1787779430.013534:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000009b5ce470/0x9e63ba8af6888cf8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9e63ba8af6888cf1 expref: 13 pid: 5828 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779430.013556:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787779430.013562:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cb634764 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c28aae66-2825-42c5-8f52-61f687e868c9+13:3305:x1874622524951552:12345-0@lo:103: 00010000:00010000:1.0:1787779430.013572:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787779430.013577:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000009b5ce470/0x9e63ba8af6888cf8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9e63ba8af6888cf1 expref: 13 pid: 5828 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779430.013585:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000009b5ce470/0x9e63ba8af6888cf8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9e63ba8af6888cf1 expref: 13 pid: 5828 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779430.013606:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000110a53d4/0x9e63ba8af6888d29 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779430.013613:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000110a53d4/0x9e63ba8af6888d29 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787779430.013626:0:5821:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001231603s 00010000:00010000:1.0:1787779430.013629:0:5821:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000110a53d4/0x9e63ba8af6888d29 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779430.013635:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000110a53d4/0x9e63ba8af6888d29 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779430.013641:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000110a53d4/0x9e63ba8af6888d29 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779430.013647:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000110a53d4/0x9e63ba8af6888d29 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779430.013652:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000110a53d4 already unused, calling callback (0000000061448218) 00010000:00010000:1.0:1787779430.013655:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000110a53d4/0x9e63ba8af6888d29 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779430.013662:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000110a53d4/0x9e63ba8af6888d29 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779430.013669:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000110a53d4/0x9e63ba8af6888d29 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779430.013678:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787779430.013708:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cb634764 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c28aae66-2825-42c5-8f52-61f687e868c9+13:3305:x1874622524951552:12345-0@lo:103: Request processed in 146us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779430.013759:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787779430.013798:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006440c6c1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c28aae66-2825-42c5-8f52-61f687e868c9:3305:1874622524951552:0@lo:103: 00010000:00010000:1.0:1787779430.013824:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009b5ce470/0x9e63ba8af6888cf8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9e63ba8af6888cf1 expref: 12 pid: 5828 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779430.013834:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004c2be8f8 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5851:1874622524951424:0@lo:104: 00010000:00010000:1.0:1787779430.013844:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000110a53d4/0x9e63ba8af6888d29 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779430.013852:0:5851:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000110a53d4/0x9e63ba8af6888d29 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779430.013857:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000110a53d4/0x9e63ba8af6888d29 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779430.013862:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000110a53d4/0x9e63ba8af6888d29 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779430.029544:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005ff55c0d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+11:5817:x1874622524951296:12345-0@lo:253: Request processed in 83132us (83427us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779430.029561:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787779430.029880:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005037706f pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:5817:1874622524951296:0@lo:253: 10000000:01000000:2.0:1787779430.029895:0:5817:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787779430.029898:0:5817:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787779430.029900:0:5817:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787779430.029901:0:5817:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787779430.029903:0:5817:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787779430.029904:0:5817:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787779430.029905:0:5817:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787779430.029906:0:5817:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787779430.029907:0:5817:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787779430.029908:0:5817:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787779430.029910:0:5817:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787779430.029911:0:5817:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787779430.029912:0:5817:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787779430.029927:0:5817:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787779430.037324:0:5817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1787779430.038117:0:5817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787779430.038519:0:5817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1787779430.038682:0:5817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787779430.039138:0:5817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1787779430.039615:0:5817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1787779430.040551:0:5817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1787779430.040990:0:5817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1787779430.041354:0:5817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1787779430.041531:0:5817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1787779430.044154:0:5817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1787779430.044578:0:5817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:1.0:1787779430.133187:0:5817:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1787779430.194906:0:5817:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1787779430.194987:0:5868:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1787779430.194991:0:5868:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1787779430.195328:0:5869:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1787779430.198980:0:5817:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1787779430.199176:0:5817:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1787779430.199572:0:5817:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1787779430.199578:0:5817:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1787779430.199678:0:5817:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787779430.208019:0:5817:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1787779430.210517:0:5817:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1787779430.210583:0:5817:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1787779430.212225:0:5817:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1787779430.212449:0:5817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:3.0:1787779430.213849:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1787779430.214015:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1787779430.214149:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1787779430.215531:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1787779430.216072:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1787779430.216550:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1787779430.216963:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1787779430.217116:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1787779430.217394:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1787779430.217561:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1787779430.217706:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1787779430.218026:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1787779430.218165:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1787779430.218476:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1787779430.218624:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1787779430.219025:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1787779430.219346:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1787779430.219487:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1787779430.219609:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1787779430.220106:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1787779430.220331:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1787779430.220471:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1787779430.220596:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1787779430.221024:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1787779430.221172:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1787779430.221556:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1787779430.222132:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1787779430.222314:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1787779430.222455:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1787779430.222621:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1787779430.223128:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1787779430.223430:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1787779430.223682:0:5817:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:1.0:1787779430.246986:0:5869:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:1.0:1787779430.306537:0:5817:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1787779430.306570:0:5817:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbf1d81c83988 00100000:10000000:1.0:1787779430.306578:0:5817:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1787779430.309504:0:5817:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787779430.309522:0:5817:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.109@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787779430.309537:0:5817:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1787779430.309554:0:5817:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:3.0:1787779430.314965:0:5869:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787779430.315044:0:5869:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1787779430.315050:0:5869:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:2.0:1787779430.962996:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779431.991321:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779433.021639:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779434.034991:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787779434.422731:0:5833:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787779434.422740:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98e846b05800 from 3 10000000:01000000:1.0:1787779434.422746:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787779434.422794:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: 000000002f874b20/0x9e63ba8af6888d30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779434.422818:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: 000000002f874b20/0x9e63ba8af6888d30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779434.422831:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: 000000002f874b20/0x9e63ba8af6888d30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779434.422858:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006440c6c1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524951680:0@lo:101: 00000100:00100000:1.0:1787779434.422929:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779434.422979:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cfefe19f going to sleep for 11 seconds 00000100:00100000:2.0:1787779434.423117:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524951680 00000100:00100000:2.0:1787779434.423125:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524951680 00000100:00100000:2.0:1787779434.423165:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787779434.423171:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a6c1e0c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+11:5833:x1874622524951680:12345-0@lo:101: 00010000:00010000:2.0:1787779434.423183:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779434.423207:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002689ac95/0x9e63ba8af6888d37 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9e63ba8af6888d30 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779434.423227:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002689ac95/0x9e63ba8af6888d37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9e63ba8af6888d30 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779434.423235:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002689ac95/0x9e63ba8af6888d37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af6888d30 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779434.423242:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002689ac95, rc 0) 00000100:00100000:2.0:1787779434.423282:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a6c1e0c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+12:5833:x1874622524951680:12345-0@lo:101: Request processed in 111us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779434.423289:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787779434.424938:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006440c6c1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524951680:0@lo:101: 00010000:00010000:1.0:1787779434.424962:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: 000000002f874b20/0x9e63ba8af6888d30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888d37 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779434.424973:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: 000000002f874b20/0x9e63ba8af6888d30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9e63ba8af6888d37 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779434.425039:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006440c6c1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524951808:0@lo:256: 00000100:00100000:1.0:1787779434.425089:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779434.425129:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cfefe19f going to sleep for 11 seconds 00000100:00100000:2.0:1787779434.425185:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524951808 00000100:00100000:2.0:1787779434.425201:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524951808 00000100:00100000:2.0:1787779434.425244:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787779434.425251:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000031bb7732 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+12:5833:x1874622524951808:12345-0@lo:256: 20000000:01000000:2.0:1787779434.425269:0:5828:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787779434.425288:0:5828:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787779434.425291:0:5828:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1787779434.425370:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000031bb7732 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+12:5833:x1874622524951808:12345-0@lo:256: Request processed in 120us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779434.425378:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787779434.425788:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006440c6c1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524951808:0@lo:256: 10000000:01000000:1.0:1787779434.425837:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787779434.425843:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: 000000002f874b20/0x9e63ba8af6888d30 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888d37 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779434.425859:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: 000000002f874b20/0x9e63ba8af6888d30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888d37 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779435.064201:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787779435.440439:0:6112:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg109-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:3.0:1787779435.443596:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787779435.443607:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787779435.443610:0:36:0:(import.c:65:import_set_state_nolock()) 00000000c509af7d lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787779435.443624:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000c509af7d using connection 192.168.201.109@tcp/0@lo 00000100:00100000:3.0:1787779435.443645:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000f7d1c2f0 x1874622524952064/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787779435.443680:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f7d1c2f0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874622524952064:0@lo:38: 00000100:00100000:3.0:1787779435.444304:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779435.444470:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787779435.444480:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d533870a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c28aae66-2825-42c5-8f52-61f687e868c9:3307:1874622524951936:0@lo:400: 00000100:00100000:0.0:1787779435.444520:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779435.444564:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524952064 00000100:00100000:0.0:1787779435.444570:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524952064 00000100:00100000:0.0:1787779435.444600:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787779435.444606:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f318be0c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3303:x1874622524952064:12345-0@lo:38: 00010000:00080000:0.0:1787779435.444631:0:5837:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 201 last 0 00000020:00000080:0.0:1787779435.444666:0:5837:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x9e63ba8af6888d3e 00000004:00100000:0.0:1787779435.444791:0:5837:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:3.0:1787779435.445064:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524951936 00000100:00100000:3.0:1787779435.445069:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524951936 00000100:00100000:3.0:1787779435.445103:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787779435.445110:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002fe74c97 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+12:3307:x1874622524951936:12345-0@lo:400: 00000100:00100000:3.0:1787779435.445157:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002fe74c97 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+12:3307:x1874622524951936:12345-0@lo:400: Request processed in 49us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779435.445164:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1787779435.445278:0:5837:0:(import.c:65:import_set_state_nolock()) 00000000bdf388aa : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787779435.445321:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f318be0c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874622524952064:12345-0@lo:38: Request processed in 714us (1019us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779435.445328:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787779435.445363:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d533870a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c28aae66-2825-42c5-8f52-61f687e868c9:3307:1874622524951936:0@lo:400: 00010000:00080000:3.0:1787779435.446145:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000f7d1c2f0 x1874622524952064/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787779445 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787779435.446163:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1787779435.447033:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1787779435.447039:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787779435.447042:0:3303:0:(import.c:65:import_set_state_nolock()) 00000000c509af7d lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787779435.447050:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f7d1c2f0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874622524952064:0@lo:38: 00010000:00010000:2.0:1787779436.083688:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779437.108220:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779438.130946:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779439.155261:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779440.183536:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779440.564167:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787779440.564189:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000041417f83 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c28aae66-2825-42c5-8f52-61f687e868c9:3306:1874622524952192:0@lo:400: 00000100:00100000:0.0:1787779440.564262:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779440.564316:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005dffe292 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874622524952320:0@lo:400: 00000100:00100000:0.0:1787779440.564347:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779440.564385:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524952192 00000100:00100000:0.0:1787779440.564392:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524952192 00000100:00100000:0.0:1787779440.564441:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787779440.564449:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000008318cb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+12:3306:x1874622524952192:12345-0@lo:400: 00000100:00100000:0.0:1787779440.564494:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000008318cb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+12:3306:x1874622524952192:12345-0@lo:400: Request processed in 46us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779440.564513:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787779440.564545:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524952320 00000100:00100000:0.0:1787779440.564548:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524952320 00000100:00100000:0.0:1787779440.564570:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787779440.564576:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f6b76717 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874622524952320:12345-0@lo:400: 00000100:00100000:0.0:1787779440.564609:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f6b76717 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874622524952320:12345-0@lo:400: Request processed in 33us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779440.564615:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787779440.564647:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000005dffe292 x1874622524952320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779440.564660:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005dffe292 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874622524952320:0@lo:400: 00000100:00100000:0.0:1787779440.564682:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000041417f83 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c28aae66-2825-42c5-8f52-61f687e868c9:3306:1874622524952192:0@lo:400: 00000020:00000080:1.0:1787779440.611327:0:6314:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc04590880 20000000:00000080:1.0:1787779440.611345:0:6314:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98e847628800 uarg=0000000000000000 20000000:01000000:1.0:1787779440.611378:0:6314:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1787779440.611385:0:6314:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1787779440.611390:0:6314:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1787779440.611634:0:6314:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1787779440.611646:0:6314:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1787779440.617148:0:6314:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787779440.617414:0:6314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1787779440.617471:0:6314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1787779440.617520:0:6314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1787779440.617538:0:6314:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787779440.617557:0:6314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000002a52e2ed/0x9e63ba8af6888d45 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779440.617578:0:6314:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000038d1f7b6/0x9e63ba8af6888d06 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af6888cff expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779440.617585:0:6314:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000002a52e2ed/0x9e63ba8af6888d45 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779440.617625:0:6314:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000038d1f7b6/0x9e63ba8af6888d06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9e63ba8af6888cff expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779440.617641:0:6314:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000038d1f7b6/0x9e63ba8af6888d06 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9e63ba8af6888cff expref: 11 pid: 5831 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779440.617667:0:6314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000065b0614a pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6314:1874622524952448:0@lo:104: 00000100:00100000:1.0:1787779440.617989:0:6314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779440.618097:0:6314:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d9eea1d0 going to sleep for 11 seconds 00000100:00100000:0.0:1787779440.618700:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524952448 00000100:00100000:0.0:1787779440.618708:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524952448 00000100:00100000:0.0:1787779440.618784:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787779440.618793:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004db969be pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c28aae66-2825-42c5-8f52-61f687e868c9+3:6314:x1874622524952448:12345-0@lo:104: 00010000:00010000:0.0:1787779440.618806:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.109@tcp lock: 00000000c580c7b3/0x9e63ba8af6888cff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9e63ba8af6888d06 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779440.618873:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787779440.618879:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004db969be pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c28aae66-2825-42c5-8f52-61f687e868c9+3:6314:x1874622524952448:12345-0@lo:104: Request processed in 88us (890us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779440.618886:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1787779440.618908:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787779440.618913:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: 00000000c580c7b3/0x9e63ba8af6888cff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9e63ba8af6888d06 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779440.618932:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c580c7b3 already unused, calling callback (000000001eabe820) 10000000:00010000:0.0:1787779440.618934:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: 00000000c580c7b3/0x9e63ba8af6888cff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9e63ba8af6888d06 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779440.618941:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: 00000000c580c7b3/0x9e63ba8af6888cff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9e63ba8af6888d06 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787779440.618947:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: 00000000c580c7b3/0x9e63ba8af6888cff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9e63ba8af6888d06 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787779440.618951:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787779440.618982:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.109@tcp lock: 00000000c580c7b3/0x9e63ba8af6888cff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af6888d06 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779440.618989:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787779440.619006:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: 00000000c580c7b3/0x9e63ba8af6888cff lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af6888d06 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779440.619012:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: 00000000c580c7b3/0x9e63ba8af6888cff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af6888d06 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779440.619191:0:6314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000065b0614a pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6314:1874622524952448:0@lo:104: 00010000:00010000:3.0:1787779440.619211:0:6314:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000002a52e2ed/0x9e63ba8af6888d45 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779440.619362:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779440.619365:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779440.619367:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779440.619386:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000041417f83 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c28aae66-2825-42c5-8f52-61f687e868c9:3305:1874622524952576:0@lo:103: 00000100:00100000:0.0:1787779440.619427:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779440.619511:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524952576 00000100:00100000:1.0:1787779440.619516:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524952576 00010000:00010000:1.0:1787779440.619536:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000038d1f7b6/0x9e63ba8af6888d06 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9e63ba8af6888cff expref: 12 pid: 5831 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779440.619567:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787779440.619573:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005dffe292 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c28aae66-2825-42c5-8f52-61f687e868c9+12:3305:x1874622524952576:12345-0@lo:103: 00010000:00010000:1.0:1787779440.619583:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787779440.619587:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000038d1f7b6/0x9e63ba8af6888d06 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9e63ba8af6888cff expref: 12 pid: 5831 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779440.619596:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000038d1f7b6/0x9e63ba8af6888d06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9e63ba8af6888cff expref: 12 pid: 5831 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779440.619609:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000038d1f7b6/0x9e63ba8af6888d06 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9e63ba8af6888cff expref: 12 pid: 5831 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779440.619621:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000002a52e2ed/0x9e63ba8af6888d45 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779440.619628:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002a52e2ed/0x9e63ba8af6888d45 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779440.619642:0:5821:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002a52e2ed/0x9e63ba8af6888d45 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779440.619660:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002a52e2ed/0x9e63ba8af6888d45 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779440.619666:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000002a52e2ed/0x9e63ba8af6888d45 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779440.619671:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000002a52e2ed/0x9e63ba8af6888d45 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779440.619675:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002a52e2ed already unused, calling callback (0000000061448218) 00010000:00010000:1.0:1787779440.619678:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000002a52e2ed/0x9e63ba8af6888d45 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779440.619684:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000002a52e2ed/0x9e63ba8af6888d45 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779440.619704:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000002a52e2ed/0x9e63ba8af6888d45 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779440.620015:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787779440.620063:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005dffe292 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c28aae66-2825-42c5-8f52-61f687e868c9+11:3305:x1874622524952576:12345-0@lo:103: Request processed in 490us (636us total) trans 0 rc 0/0 00010000:00010000:3.0:1787779440.620190:0:6314:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000002a52e2ed/0x9e63ba8af6888d45 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779440.620199:0:6314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000002a52e2ed/0x9e63ba8af6888d45 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779440.620204:0:6314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002a52e2ed/0x9e63ba8af6888d45 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779440.621866:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787779440.622226:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000041417f83 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c28aae66-2825-42c5-8f52-61f687e868c9:3305:1874622524952576:0@lo:103: 00010000:00010000:0.0:1787779441.203202:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779442.236166:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779443.257307:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787779443.573278:0:5833:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787779443.573288:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98e846b05800 from 1 10000000:01000000:0.0:1787779443.573294:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787779443.573349:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: 00000000d5b7a3da/0x9e63ba8af6888d4c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779443.573362:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: 00000000d5b7a3da/0x9e63ba8af6888d4c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779443.573372:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: 00000000d5b7a3da/0x9e63ba8af6888d4c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779443.573395:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000041417f83 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524952704:0@lo:101: 00000100:00100000:0.0:1787779443.573470:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779443.573533:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set 0000000051c6577e going to sleep for 11 seconds 00000100:00100000:1.0:1787779443.574991:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524952704 00000100:00100000:1.0:1787779443.575009:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524952704 00000100:00100000:1.0:1787779443.575082:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787779443.575092:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000831b45c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+11:5833:x1874622524952704:12345-0@lo:101: 00010000:00010000:1.0:1787779443.576928:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779443.576958:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008a8b8cac/0x9e63ba8af6888d53 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9e63ba8af6888d4c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779443.577004:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008a8b8cac/0x9e63ba8af6888d53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9e63ba8af6888d4c expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779443.577015:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008a8b8cac/0x9e63ba8af6888d53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af6888d4c expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779443.577023:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008a8b8cac, rc 0) 00000100:00100000:1.0:1787779443.577118:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000831b45c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+12:5833:x1874622524952704:12345-0@lo:101: Request processed in 2027us (3647us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779443.577127:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787779443.577198:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000041417f83 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524952704:0@lo:101: 00010000:00010000:3.0:1787779443.577228:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: 00000000d5b7a3da/0x9e63ba8af6888d4c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888d53 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779443.577237:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: 00000000d5b7a3da/0x9e63ba8af6888d4c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9e63ba8af6888d53 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779443.577306:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a93cde4b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524952832:0@lo:501: 00000100:00100000:3.0:1787779443.577342:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779443.577380:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set 0000000062fe52c7 going to sleep for 11 seconds 00000100:00100000:1.0:1787779443.577989:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524952832 00000100:00100000:1.0:1787779443.577995:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524952832 00000100:00100000:1.0:1787779443.578044:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787779443.578053:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008c9ab441 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+12:5833:x1874622524952832:12345-0@lo:501: 00000100:00100000:2.0:1787779443.582149:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008c9ab441 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+12:5833:x1874622524952832:12345-0@lo:501: Request processed in 4087us (4796us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779443.582167:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787779443.584425:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a93cde4b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524952832:0@lo:501: 00000100:00100000:0.0:1787779443.584517:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000063569ff0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524952960:0@lo:503: 00000100:00100000:0.0:1787779443.584586:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779443.584646:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set 000000006c9a69ca going to sleep for 11 seconds 00000100:00100000:1.0:1787779443.591217:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524952960 00000100:00100000:1.0:1787779443.591229:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524952960 00000100:00100000:1.0:1787779443.591294:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787779443.591303:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000007ce736a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+12:5833:x1874622524952960:12345-0@lo:503: 00000100:00100000:1.0:1787779443.591551:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000007ce736a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+12:5833:x1874622524952960:12345-0@lo:503: Request processed in 250us (6966us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779443.591560:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787779443.591624:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000063569ff0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524952960:0@lo:503: 00000100:00100000:1.0:1787779443.592092:0:6395:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000531560e4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c28aae66-2825-42c5-8f52-61f687e868c9:6395:1874622524953088:0@lo:502: 00000100:00100000:1.0:1787779443.594504:0:6395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779443.594578:0:6395:0:(client.c:2715:ptlrpc_set_wait()) set 000000001725224e going to sleep for 11 seconds 00000100:00100000:2.0:1787779443.597113:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524953088 00000100:00100000:2.0:1787779443.597130:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524953088 00000100:00100000:2.0:1787779443.597187:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787779443.597195:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000081768400 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+12:6395:x1874622524953088:12345-0@lo:502: 00000100:00100000:2.0:1787779443.597425:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000081768400 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+12:6395:x1874622524953088:12345-0@lo:502: Request processed in 230us (2929us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779443.597434:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787779443.599182:0:6395:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000531560e4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c28aae66-2825-42c5-8f52-61f687e868c9:6395:1874622524953088:0@lo:502: 00000020:01000000:1.0:1787779443.599235:0:6395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787779443.599245:0:6395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787779443.599247:0:6395:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787779443.599254:0:6395:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98e846b05800 00000020:00000080:1.0:1787779443.599257:0:6395:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787779443.599311:0:6395:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e8521130c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c28aae66-2825-42c5-8f52-61f687e868c9:6395:1874622524953216:0@lo:502: 00000100:00100000:1.0:1787779443.599372:0:6395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779443.599416:0:6395:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e8450ff840 going to sleep for 11 seconds 00000100:00100000:0.0:1787779443.600818:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524953216 00000100:00100000:0.0:1787779443.600828:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524953216 00000100:00100000:0.0:1787779443.600876:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787779443.600885:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842efb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+12:6395:x1874622524953216:12345-0@lo:502: 00000100:00100000:0.0:1787779443.601096:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842efb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+12:6395:x1874622524953216:12345-0@lo:502: Request processed in 211us (1723us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779443.601104:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787779443.602898:0:6395:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e8521130c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c28aae66-2825-42c5-8f52-61f687e868c9:6395:1874622524953216:0@lo:502: 00000020:01000000:1.0:1787779443.602948:0:6395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787779443.602958:0:6395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787779443.602960:0:6395:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1787779443.602965:0:6395:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1787779443.603197:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1787779443.603216:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787779443.603236:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e840030400/0x9e63ba8af6888d4c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888d53 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779443.603246:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff98e840030400/0x9e63ba8af6888d4c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888d53 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779444.277375:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779445.299816:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779445.684228:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e8521130c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c28aae66-2825-42c5-8f52-61f687e868c9:3306:1874622524953344:0@lo:400: 00000100:00100000:1.0:1787779445.684328:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779445.684389:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787779445.684396:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e852113840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874622524953472:0@lo:400: 00000100:00100000:1.0:1787779445.684426:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779445.684467:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524953344 00000100:00100000:1.0:1787779445.684474:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524953344 00000100:00100000:1.0:1787779445.684522:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787779445.684531:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842efa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+12:3306:x1874622524953344:12345-0@lo:400: 00000100:00100000:1.0:1787779445.684582:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842efa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+12:3306:x1874622524953344:12345-0@lo:400: Request processed in 52us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779445.684589:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787779445.684701:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524953472 00000100:00100000:1.0:1787779445.684705:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524953472 00000100:00100000:1.0:1787779445.685738:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787779445.686875:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e852111a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874622524953472:12345-0@lo:400: 00000100:00100000:1.0:1787779445.687543:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e852111a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874622524953472:12345-0@lo:400: Request processed in 1216us (2550us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779445.687554:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787779445.687641:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98e852113840 x1874622524953472/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779445.687656:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e852113840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874622524953472:0@lo:400: 00000100:00100000:1.0:1787779445.687671:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e8521130c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c28aae66-2825-42c5-8f52-61f687e868c9:3306:1874622524953344:0@lo:400: 00010000:00010000:0.0:1787779446.323199:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779447.356021:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787779448.114749:0:6677:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787779448.114754:0:6677:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1787779448.115813:0:6677:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff98e848ee5800 00000020:01000004:0.0:1787779448.115836:0:6677:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1787779448.115848:0:6677:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1787779448.115864:0:6677:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff98e848ef0000) 00000020:00000080:0.0:1787779448.115883:0:6677:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787779448.168514:0:6677:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1787779448.168884:0:6677:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1787779448.227229:0:6677:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1787779448.234707:0:6677:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1787779448.234786:0:6677:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1787779448.234844:0:6677:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1787779448.234871:0:6677:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1787779448.235213:0:6677:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1787779448.235223:0:6677:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787779448.235232:0:6677:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9e63ba8af6888d61 00000020:01000004:0.0:1787779448.235240:0:6677:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:0.0:1787779448.235260:0:6677:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.109@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787779448.235264:0:6677:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.109@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787779448.235269:0:6677:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1787779448.235274:0:6677:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1787779448.235290:0:6677:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff98e848ef3370) 00000020:00000080:0.0:1787779448.235300:0:6677:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:0.0:1787779448.243340:0:6677:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787779448.243539:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1787779448.243546:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1787779448.246571:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1787779448.246583:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1787779448.247402:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1787779448.247409:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1787779448.248804:0:6677:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787779448.250785:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1787779448.250797:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1787779448.252250:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1787779448.252258:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1787779448.289127:0:6677:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787779448.289642:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787779448.289649:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1787779448.293230:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787779448.293246:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1787779448.294454:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787779448.294465:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1787779448.300000:0:6677:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787779448.300180:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1787779448.300257:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1787779448.301155:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1787779448.301165:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00010000:00010000:1.0:1787779448.371830:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779448.394141:0:6677:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787779448.394409:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1787779448.394619:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1787779448.399004:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1787779448.399030:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1787779448.400981:0:6677:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1787779448.401012:0:6677:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1787779448.401019:0:6677:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.109@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1787779448.433952:0:6677:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.109@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787779448.433990:0:6677:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.109@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1787779448.433994:0:6677:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787779448.433995:0:6677:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787779448.433997:0:6677:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787779448.433998:0:6677:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787779448.433999:0:6677:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787779448.434001:0:6677:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787779448.434002:0:6677:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787779448.434004:0:6677:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787779448.434005:0:6677:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787779448.434007:0:6677:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787779448.434009:0:6677:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787779448.434013:0:6677:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1787779448.434015:0:6677:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787779448.434016:0:6677:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787779448.434017:0:6677:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787779448.434018:0:6677:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787779448.434019:0:6677:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787779448.434020:0:6677:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787779448.434021:0:6677:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787779448.434022:0:6677:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787779448.434023:0:6677:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787779448.434025:0:6677:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787779448.434025:0:6677:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787779448.434055:0:6677:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787779448.434074:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855b3d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:6677:1874622524953600:0@lo:253: 00000100:00100000:2.0:1787779448.434144:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779448.434203:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e8480b3000 going to sleep for 11 seconds 00000100:00100000:1.0:1787779448.434584:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524953600 00000100:00100000:1.0:1787779448.434591:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524953600 00000100:00100000:1.0:1787779448.434640:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787779448.434650:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842efac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+12:6677:x1874622524953600:12345-0@lo:253: 20000000:01000000:1.0:1787779448.434691:0:5830:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787779448.434696:0:5830:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1787779448.434702:0:5830:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1787779448.434705:0:5830:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1787779448.435627:0:5830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787779448.435867:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1787779448.435882:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1787779448.435921:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:1.0:1787779448.435938:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1787779448.435979:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:1.0:1787779448.436021:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:1.0:1787779448.436349:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1787779448.436368:0:5830:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.109@tcp 20000000:01000000:1.0:1787779448.436371:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.109@tcp (null) (null) (null) 00000040:00080000:1.0:1787779448.436397:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1787779448.436404:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787779448.436452:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1787779448.436460:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.201.109@tcp (null) (null) 00000040:00080000:1.0:1787779448.436487:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1787779448.436494:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1787779448.436517:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1787779448.436553:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:1.0:1787779448.437320:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1787779448.437340:0:5830:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.109@tcp 20000000:01000000:1.0:1787779448.437341:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.109@tcp (null) (null) (null) 00000040:00080000:1.0:1787779448.437371:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1787779448.437379:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1787779448.437406:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1787779448.437413:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.201.109@tcp (null) (null) 00000040:00080000:1.0:1787779448.437454:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1787779448.437463:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1787779448.437495:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:1.0:1787779448.437526:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:1.0:1787779448.437540:0:5830:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:1.0:1787779448.437543:0:5830:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1787779448.437546:0:5830:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1787779448.437556:0:5830:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787779448.437559:0:5830:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1787779448.437589:0:5830:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1787779448.437591:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787779448.442149:0:6692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1787779448.442630:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:0.0:1787779448.442679:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:0.0:1787779448.442798:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:0.0:1787779448.442814:0:5830:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787779448.442816:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787779448.443888:0:6693:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1787779448.444040:0:6693:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1787779448.444089:0:6693:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1787779448.444816:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:1.0:1787779448.444860:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:1.0:1787779448.444976:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:1.0:1787779448.444991:0:5830:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787779448.444993:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787779448.445705:0:6694:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1787779448.446012:0:6694:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1787779448.446070:0:6694:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1787779448.447502:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1787779448.447543:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1787779448.447608:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1787779448.447627:0:5830:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:0.0:1787779448.447629:0:5830:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:0.0:1787779448.447638:0:5830:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787779448.447657:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98e840030200/0x9e63ba8af6888d6f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779448.447675:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98e8429d4a00/0x9e63ba8af6888c88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af6888c81 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779448.447697:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98e841649c00/0x9e63ba8af6888ca4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af6888c9d expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779448.447704:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98e882048800/0x9e63ba8af6888d14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af6888d0d expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779448.447734:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98e840030200/0x9e63ba8af6888d6f lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779448.447779:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98e882048800/0x9e63ba8af6888d14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9e63ba8af6888d0d expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779448.447793:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98e882048800/0x9e63ba8af6888d14 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9e63ba8af6888d0d expref: 12 pid: 5831 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779448.447808:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855b003c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5830:1874622524953728:0@lo:104: 00000100:00100000:0.0:1787779448.447875:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787779448.448289:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98e841649c00/0x9e63ba8af6888ca4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9e63ba8af6888c9d expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779448.448300:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98e841649c00/0x9e63ba8af6888ca4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9e63ba8af6888c9d expref: 12 pid: 5828 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779448.448308:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855b03c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5830:1874622524953856:0@lo:104: 00000100:00100000:0.0:1787779448.448333:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787779448.448639:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98e8429d4a00/0x9e63ba8af6888c88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9e63ba8af6888c81 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779448.448649:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98e8429d4a00/0x9e63ba8af6888c88 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9e63ba8af6888c81 expref: 12 pid: 5830 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779448.448665:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855b01e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5830:1874622524953984:0@lo:104: 00000100:00100000:0.0:1787779448.448692:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779448.448999:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e844cce900 going to sleep for 11 seconds 00000100:00100000:3.0:1787779448.452032:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524953728 00000100:00100000:3.0:1787779448.452051:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524953728 00000100:00100000:3.0:1787779448.452122:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524953856 00000100:00100000:3.0:1787779448.452126:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524953856 00000100:00100000:3.0:1787779448.452139:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524953984 00000100:00100000:3.0:1787779448.452142:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524953984 00000100:00100000:3.0:1787779448.452157:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787779448.452167:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e855b021c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c28aae66-2825-42c5-8f52-61f687e868c9+5:5830:x1874622524953728:12345-0@lo:104: 00010000:00010000:3.0:1787779448.452492:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.109@tcp lock: ffff98e840030000/0x9e63ba8af6888d0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9e63ba8af6888d14 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779448.452639:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787779448.452646:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e855b021c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c28aae66-2825-42c5-8f52-61f687e868c9+5:5830:x1874622524953728:12345-0@lo:104: Request processed in 480us (4770us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779448.452653:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787779448.452672:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787779448.452679:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e855b02580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c28aae66-2825-42c5-8f52-61f687e868c9+4:5830:x1874622524953856:12345-0@lo:104: 00010000:00010000:3.0:1787779448.452688:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.109@tcp lock: ffff98e882048a00/0x9e63ba8af6888c9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9e63ba8af6888ca4 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779448.452783:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787779448.452789:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e855b02580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c28aae66-2825-42c5-8f52-61f687e868c9+4:5830:x1874622524953856:12345-0@lo:104: Request processed in 112us (4456us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779448.452795:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787779448.452808:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787779448.452813:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e855b03480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c28aae66-2825-42c5-8f52-61f687e868c9+3:5830:x1874622524953984:12345-0@lo:104: 00010000:00010000:3.0:1787779448.452821:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.109@tcp lock: ffff98e841649a00/0x9e63ba8af6888c81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9e63ba8af6888c88 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779448.452847:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787779448.452852:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e855b03480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c28aae66-2825-42c5-8f52-61f687e868c9+3:5830:x1874622524953984:12345-0@lo:104: Request processed in 40us (4160us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779448.452857:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1787779448.452939:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787779448.452955:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff98e840030000/0x9e63ba8af6888d0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9e63ba8af6888d14 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779448.452962:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e840030000 already unused, calling callback (ffffffffc1cd5c20) 10000000:00010000:2.0:1787779448.452966:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff98e840030000/0x9e63ba8af6888d0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9e63ba8af6888d14 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779448.452985:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff98e840030000/0x9e63ba8af6888d0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9e63ba8af6888d14 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787779448.452993:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff98e840030000/0x9e63ba8af6888d0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9e63ba8af6888d14 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787779448.452998:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787779448.453045:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.109@tcp lock: ffff98e840030000/0x9e63ba8af6888d0d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af6888d14 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779448.453052:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787779448.453072:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff98e840030000/0x9e63ba8af6888d0d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af6888d14 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779448.453080:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff98e840030000/0x9e63ba8af6888d0d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af6888d14 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779448.453094:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787779448.453097:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff98e882048a00/0x9e63ba8af6888c9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9e63ba8af6888ca4 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779448.453102:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e882048a00 already unused, calling callback (ffffffffc1cd5c20) 10000000:00010000:2.0:1787779448.453104:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff98e882048a00/0x9e63ba8af6888c9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9e63ba8af6888ca4 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779448.453122:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff98e882048a00/0x9e63ba8af6888c9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9e63ba8af6888ca4 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787779448.453128:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff98e882048a00/0x9e63ba8af6888c9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9e63ba8af6888ca4 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787779448.453140:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787779448.453154:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.109@tcp lock: ffff98e882048a00/0x9e63ba8af6888c9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af6888ca4 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779448.453159:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787779448.453164:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff98e882048a00/0x9e63ba8af6888c9d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af6888ca4 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779448.453169:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff98e882048a00/0x9e63ba8af6888c9d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af6888ca4 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779448.453179:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787779448.453190:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff98e841649a00/0x9e63ba8af6888c81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9e63ba8af6888c88 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779448.453196:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e841649a00 already unused, calling callback (ffffffffc1cd5c20) 10000000:00010000:2.0:1787779448.453199:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff98e841649a00/0x9e63ba8af6888c81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9e63ba8af6888c88 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779448.453204:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff98e841649a00/0x9e63ba8af6888c81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9e63ba8af6888c88 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787779448.453210:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff98e841649a00/0x9e63ba8af6888c81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9e63ba8af6888c88 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787779448.453214:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787779448.453225:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.109@tcp lock: ffff98e841649a00/0x9e63ba8af6888c81 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af6888c88 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779448.453231:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787779448.453252:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff98e841649a00/0x9e63ba8af6888c81 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af6888c88 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779448.453258:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff98e841649a00/0x9e63ba8af6888c81 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af6888c88 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779448.453287:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779448.453288:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779448.453291:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787779448.453317:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855b3e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c28aae66-2825-42c5-8f52-61f687e868c9:3304:1874622524954112:0@lo:103: 00000100:00100000:2.0:1787779448.453363:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779448.453403:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787779448.453408:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855b3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c28aae66-2825-42c5-8f52-61f687e868c9:3304:1874622524954240:0@lo:103: 00000100:00100000:2.0:1787779448.453441:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779448.453479:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524954112 00000100:00100000:2.0:1787779448.453485:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524954112 00010000:00010000:2.0:1787779448.453507:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98e882048800/0x9e63ba8af6888d14 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9e63ba8af6888d0d expref: 13 pid: 5831 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779448.453529:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524954240 00000100:00100000:2.0:1787779448.453532:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524954240 00010000:00010000:2.0:1787779448.453543:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98e841649c00/0x9e63ba8af6888ca4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9e63ba8af6888c9d expref: 14 pid: 5828 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779448.453556:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787779448.453563:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e855b3e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c28aae66-2825-42c5-8f52-61f687e868c9+14:3304:x1874622524954112:12345-0@lo:103: 00010000:00010000:2.0:1787779448.453576:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787779448.453582:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98e882048800/0x9e63ba8af6888d14 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9e63ba8af6888d0d expref: 14 pid: 5831 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779448.453602:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98e882048800/0x9e63ba8af6888d14 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9e63ba8af6888d0d expref: 14 pid: 5831 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779448.453620:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787779448.453647:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e855b3e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c28aae66-2825-42c5-8f52-61f687e868c9+14:3304:x1874622524954112:12345-0@lo:103: Request processed in 86us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779448.453655:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787779448.453672:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787779448.453677:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e855b3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c28aae66-2825-42c5-8f52-61f687e868c9+13:3304:x1874622524954240:12345-0@lo:103: 00010000:00010000:2.0:1787779448.453684:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787779448.453687:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98e841649c00/0x9e63ba8af6888ca4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9e63ba8af6888c9d expref: 13 pid: 5828 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779448.453696:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98e841649c00/0x9e63ba8af6888ca4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9e63ba8af6888c9d expref: 13 pid: 5828 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779448.453705:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787779448.453753:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e855b3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c28aae66-2825-42c5-8f52-61f687e868c9+13:3304:x1874622524954240:12345-0@lo:103: Request processed in 75us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779448.453759:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787779448.453792:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855b3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c28aae66-2825-42c5-8f52-61f687e868c9:3304:1874622524954240:0@lo:103: 00000100:00100000:2.0:1787779448.453802:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855b3e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c28aae66-2825-42c5-8f52-61f687e868c9:3304:1874622524954112:0@lo:103: 00010000:00010000:0.0:1787779448.456422:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e882048800/0x9e63ba8af6888d14 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9e63ba8af6888d0d expref: 12 pid: 5831 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779448.456443:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855b003c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5830:1874622524953728:0@lo:104: 00010000:00010000:0.0:1787779448.456457:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e841649c00/0x9e63ba8af6888ca4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9e63ba8af6888c9d expref: 11 pid: 5828 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779448.456468:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855b03c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5830:1874622524953856:0@lo:104: 00000100:00100000:0.0:1787779448.456478:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855b01e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5830:1874622524953984:0@lo:104: 00010000:00010000:0.0:1787779448.456507:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98e840030200/0x9e63ba8af6888d6f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779448.456700:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779448.456752:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855b3d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c28aae66-2825-42c5-8f52-61f687e868c9:3306:1874622524954368:0@lo:103: 00000100:00100000:1.0:1787779448.456825:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779448.457102:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524954368 00000100:00100000:1.0:1787779448.457179:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524954368 00010000:00010000:1.0:1787779448.457287:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98e8429d4a00/0x9e63ba8af6888c88 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9e63ba8af6888c81 expref: 11 pid: 5830 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779448.457353:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787779448.457362:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e852113840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c28aae66-2825-42c5-8f52-61f687e868c9+11:3306:x1874622524954368:12345-0@lo:103: 00010000:00010000:1.0:1787779448.457377:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787779448.457383:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98e8429d4a00/0x9e63ba8af6888c88 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9e63ba8af6888c81 expref: 11 pid: 5830 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779448.457396:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98e8429d4a00/0x9e63ba8af6888c88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9e63ba8af6888c81 expref: 11 pid: 5830 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779448.457429:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e8429d4a00/0x9e63ba8af6888c88 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9e63ba8af6888c81 expref: 11 pid: 5830 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779448.457446:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98e840030200/0x9e63ba8af6888d6f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779448.457475:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e840030200/0x9e63ba8af6888d6f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779448.457491:0:5821:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98e840030200/0x9e63ba8af6888d6f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779448.457498:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98e840030200/0x9e63ba8af6888d6f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779448.457504:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98e840030200/0x9e63ba8af6888d6f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779448.457510:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98e840030200/0x9e63ba8af6888d6f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779448.457517:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e840030200 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:1.0:1787779448.457521:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98e840030200/0x9e63ba8af6888d6f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779448.457529:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98e840030200/0x9e63ba8af6888d6f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779448.457547:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98e840030200/0x9e63ba8af6888d6f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779448.457558:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787779448.457611:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e852113840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c28aae66-2825-42c5-8f52-61f687e868c9+10:3306:x1874622524954368:12345-0@lo:103: Request processed in 250us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779448.457618:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787779448.457690:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855b3d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c28aae66-2825-42c5-8f52-61f687e868c9:3306:1874622524954368:0@lo:103: 00010000:00010000:0.0:1787779448.457858:0:5830:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98e840030200/0x9e63ba8af6888d6f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779448.457866:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98e840030200/0x9e63ba8af6888d6f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779448.457872:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e840030200/0x9e63ba8af6888d6f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787779448.457886:0:5830:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1787779448.544159:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842efac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+9:6677:x1874622524953600:12345-0@lo:253: Request processed in 109501us (110005us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779448.544386:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855b3d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:6677:1874622524953600:0@lo:253: 10000000:01000000:2.0:1787779448.544402:0:6677:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787779448.544405:0:6677:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787779448.544407:0:6677:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787779448.544425:0:6677:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787779448.544427:0:6677:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1787779448.544428:0:6677:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787779448.544430:0:6677:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787779448.544431:0:6677:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787779448.544432:0:6677:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787779448.544434:0:6677:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787779448.544435:0:6677:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787779448.544454:0:6677:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98e848ee5800 from lustre-OST0000 10000000:01000000:2.0:1787779448.544480:0:6677:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1787779448.544483:0:6677:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787779448.544490:0:6677:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff98e842f18000 local copy 10000000:01000000:2.0:1787779448.544493:0:6677:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787779448.544532:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e841649a00/0x9e63ba8af6888d76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779448.544543:0:6677:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.109@tcp lock: ffff98e841649a00/0x9e63ba8af6888d76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779448.544554:0:6677:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff98e841649a00/0x9e63ba8af6888d76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779448.544573:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855b3d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:6677:1874622524954496:0@lo:101: 00000100:00100000:2.0:1787779448.544611:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779448.544667:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e8490953c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787779448.544791:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787779448.544826:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524954496 00000100:00100000:1.0:1787779448.544831:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524954496 00000100:00100000:1.0:1787779448.544865:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787779448.544873:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ef8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+9:6677:x1874622524954496:12345-0@lo:101: 00010000:00010000:1.0:1787779448.544899:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779448.544912:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e8429d4a00/0x9e63ba8af6888d7d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9e63ba8af6888d76 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779448.544933:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e8429d4a00/0x9e63ba8af6888d7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9e63ba8af6888d76 expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779448.544953:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e8429d4a00/0x9e63ba8af6888d7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af6888d76 expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779448.544962:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e8429d4a00, rc 0) 00000100:00100000:1.0:1787779448.544993:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ef8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+10:6677:x1874622524954496:12345-0@lo:101: Request processed in 120us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779448.544999:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787779448.545399:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855b3d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:6677:1874622524954496:0@lo:101: 00010000:00010000:2.0:1787779448.545476:0:6677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff98e841649a00/0x9e63ba8af6888d76 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x9e63ba8af6888d7d expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779448.545486:0:6677:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff98e841649a00/0x9e63ba8af6888d76 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x9e63ba8af6888d7d expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779448.545579:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855b3d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:6677:1874622524954624:0@lo:501: 00000100:00100000:2.0:1787779448.545616:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779448.545647:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e8490953c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787779448.547868:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524954624 00000100:00100000:1.0:1787779448.547885:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524954624 00000100:00100000:1.0:1787779448.547939:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787779448.547959:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ef9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+10:6677:x1874622524954624:12345-0@lo:501: 00000100:00100000:1.0:1787779448.548644:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ef9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+10:6677:x1874622524954624:12345-0@lo:501: Request processed in 685us (3024us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787779448.548653:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787779448.550974:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855b3d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:6677:1874622524954624:0@lo:501: 10000000:01000000:2.0:1787779448.551005:0:6677:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.109@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787779448.552099:0:6677:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.109@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787779448.552109:0:6677:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e841649a00/0x9e63ba8af6888d76 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x9e63ba8af6888d7d expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779448.552122:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e841649a00/0x9e63ba8af6888d76 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x9e63ba8af6888d7d expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779448.552130:0:6677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.109@tcp lock: ffff98e841649a00/0x9e63ba8af6888d76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x9e63ba8af6888d7d expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779448.552251:0:6677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787779448.552273:0:6677:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98e848ee5800 10000000:01000000:2.0:1787779448.552278:0:6677:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787779448.552283:0:6677:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff98e842f18000 10000000:01000000:2.0:1787779448.552286:0:6677:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1787779448.552289:0:6677:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff98e842f18000 from 1 10000000:01000000:2.0:1787779448.552292:0:6677:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1787779448.552324:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e841648800/0x9e63ba8af6888d84 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779448.552333:0:6677:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff98e841648800/0x9e63ba8af6888d84 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779448.552344:0:6677:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff98e841648800/0x9e63ba8af6888d84 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779448.552383:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855b3d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:6677:1874622524954752:0@lo:101: 00000100:00100000:2.0:1787779448.552450:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779448.552514:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e849095180 going to sleep for 11 seconds 00000100:00100000:3.0:1787779448.552674:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524954752 00000100:00100000:3.0:1787779448.552681:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524954752 00000100:00100000:3.0:1787779448.552746:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787779448.552755:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842efbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+10:6677:x1874622524954752:12345-0@lo:101: 00010000:00010000:3.0:1787779448.552768:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779448.552782:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e882049600/0x9e63ba8af6888d8b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9e63ba8af6888d84 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779448.552803:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e882049600/0x9e63ba8af6888d8b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9e63ba8af6888d84 expref: 11 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779448.552813:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e882049600/0x9e63ba8af6888d8b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af6888d84 expref: 11 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779448.552828:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e882049600, rc 0) 00000100:00100000:3.0:1787779448.552864:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842efbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+11:6677:x1874622524954752:12345-0@lo:101: Request processed in 111us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779448.552871:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787779448.553042:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855b3d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:6677:1874622524954752:0@lo:101: 00010000:00010000:2.0:1787779448.553055:0:6677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff98e841648800/0x9e63ba8af6888d84 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888d8b expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779448.553064:0:6677:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff98e841648800/0x9e63ba8af6888d84 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9e63ba8af6888d8b expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787779448.553082:0:6677:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1787779448.553096:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e841648800/0x9e63ba8af6888d84 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888d8b expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779448.553103:0:6677:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff98e841648800/0x9e63ba8af6888d84 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888d8b expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787779448.553111:0:6677:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787779448.553114:0:6677:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787779448.553119:0:6677:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1787779448.553121:0:6677:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787779448.553135:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e841648a00/0x9e63ba8af6888d92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779448.553142:0:6677:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff98e841648a00/0x9e63ba8af6888d92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779448.553149:0:6677:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff98e841648a00/0x9e63ba8af6888d92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779448.553165:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855b3d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:6677:1874622524954880:0@lo:101: 00000100:00100000:2.0:1787779448.553254:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779448.553278:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e849095180 going to sleep for 11 seconds 00000100:00100000:1.0:1787779448.553327:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524954880 00000100:00100000:1.0:1787779448.553331:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524954880 00000100:00100000:1.0:1787779448.553368:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787779448.553374:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ebfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+11:6677:x1874622524954880:12345-0@lo:101: 00010000:00010000:1.0:1787779448.553381:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779448.553390:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e8429d4e00/0x9e63ba8af6888d99 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9e63ba8af6888d92 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779448.553405:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e8429d4e00/0x9e63ba8af6888d99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9e63ba8af6888d92 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779448.553422:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e8429d4e00/0x9e63ba8af6888d99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af6888d92 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779448.553429:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e8429d4e00, rc 0) 00000100:00100000:1.0:1787779448.553455:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ebfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+12:6677:x1874622524954880:12345-0@lo:101: Request processed in 82us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779448.553461:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787779448.553671:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855b3d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:6677:1874622524954880:0@lo:101: 00010000:00010000:2.0:1787779448.553681:0:6677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff98e841648a00/0x9e63ba8af6888d92 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888d99 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779448.553689:0:6677:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff98e841648a00/0x9e63ba8af6888d92 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9e63ba8af6888d99 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779448.553807:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855b3d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:6677:1874622524955008:0@lo:501: 00000100:00100000:2.0:1787779448.553830:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779448.553843:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e849095180 going to sleep for 11 seconds 00000100:00100000:1.0:1787779448.553926:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524955008 00000100:00100000:1.0:1787779448.553929:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524955008 00000100:00100000:1.0:1787779448.553965:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787779448.553971:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ebcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+12:6677:x1874622524955008:12345-0@lo:501: 00000100:00100000:1.0:1787779448.554187:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ebcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+12:6677:x1874622524955008:12345-0@lo:501: Request processed in 208us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779448.554195:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787779448.554403:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855b3d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:6677:1874622524955008:0@lo:501: 00000100:00100000:3.0:1787779448.554440:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855a62580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:6677:1874622524955136:0@lo:503: 00000100:00100000:3.0:1787779448.554475:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779448.554499:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e846b0e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787779448.554634:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524955136 00000100:00100000:1.0:1787779448.554639:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524955136 00000100:00100000:1.0:1787779448.554673:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787779448.554678:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ebdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+12:6677:x1874622524955136:12345-0@lo:503: 00000100:00100000:1.0:1787779448.554830:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ebdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+12:6677:x1874622524955136:12345-0@lo:503: Request processed in 151us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779448.554842:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787779448.555272:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855a62580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:6677:1874622524955136:0@lo:503: 00000040:00080000:3.0:1787779448.555833:0:6677:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787779448.555908:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855a62580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:6677:1874622524955264:0@lo:502: 00000100:00100000:3.0:1787779448.555968:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779448.556000:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e846b0e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787779448.556217:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524955264 00000100:00100000:2.0:1787779448.556224:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524955264 00000100:00100000:2.0:1787779448.556262:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787779448.556271:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ebc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+12:6677:x1874622524955264:12345-0@lo:502: 00000100:00100000:2.0:1787779448.556459:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ebc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+12:6677:x1874622524955264:12345-0@lo:502: Request processed in 188us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779448.556466:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787779448.556683:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855a62580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:6677:1874622524955264:0@lo:502: 00000040:00080000:3.0:1787779448.556969:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787779448.557031:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1787779448.557067:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1787779448.557113:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1787779448.557151:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1787779448.557308:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1787779448.557339:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855a62580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:6677:1874622524955392:0@lo:502: 00000100:00100000:3.0:1787779448.557392:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779448.557430:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e846b0e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787779448.557573:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524955392 00000100:00100000:1.0:1787779448.557578:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524955392 00000100:00100000:1.0:1787779448.557619:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787779448.557627:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ebf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+12:6677:x1874622524955392:12345-0@lo:502: 00000100:00100000:1.0:1787779448.557831:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ebf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+12:6677:x1874622524955392:12345-0@lo:502: Request processed in 201us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779448.557838:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787779448.557930:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855a62580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:6677:1874622524955392:0@lo:502: 00000040:00080000:3.0:1787779448.558033:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1787779448.558050:0:6677:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00010000:00010000:0.0:1787779448.558624:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787779448.558632:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff98e841649a00/0x9e63ba8af6888d76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x9e63ba8af6888d7d expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779448.558654:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e841649a00 already unused, calling callback (ffffffffc1cd5c20) 10000000:00010000:0.0:1787779448.558658:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff98e841649a00/0x9e63ba8af6888d76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x9e63ba8af6888d7d expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779448.558666:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff98e841649a00/0x9e63ba8af6888d76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x9e63ba8af6888d7d expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787779448.558673:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff98e841649a00/0x9e63ba8af6888d76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x9e63ba8af6888d7d expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787779448.558678:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787779448.558705:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.109@tcp lock: ffff98e841649a00/0x9e63ba8af6888d76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x9e63ba8af6888d7d expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779448.558734:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787779448.558756:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff98e841649a00/0x9e63ba8af6888d76 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x9e63ba8af6888d7d expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779448.558764:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff98e841649a00/0x9e63ba8af6888d76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x9e63ba8af6888d7d expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779448.558778:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779448.558780:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779448.558782:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787779448.558820:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787779448.558832:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855b01e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c28aae66-2825-42c5-8f52-61f687e868c9:3306:1874622524955520:0@lo:103: 00000100:00100000:2.0:1787779448.558885:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:3.0:1787779448.559277:0:6695:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787779448.559285:0:6695:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1787779448.559291:0:6695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787779448.559293:0:6695:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1787779448.559298:0:6695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787779448.559311:0:6695:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff98e874594d28) 00000020:00000080:3.0:1787779448.559329:0:6695:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787779448.559333:0:6695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787779448.559406:0:6695:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98e848ee5800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1787779448.559475:0:6695:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787779448.559482:0:6695:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9e63ba8af6888da7 00000100:00100000:0.0:1787779448.560626:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524955520 00000100:00100000:0.0:1787779448.560637:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524955520 00000100:00100000:0.0:1787779448.560690:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787779448.560697:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e855b3e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c28aae66-2825-42c5-8f52-61f687e868c9+12:3306:x1874622524955520:12345-0@lo:103: 00010000:00010000:0.0:1787779448.560723:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787779448.560750:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e8429d4a00/0x9e63ba8af6888d7d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9e63ba8af6888d76 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779448.560768:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787779448.560827:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e855b3e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c28aae66-2825-42c5-8f52-61f687e868c9+11:3306:x1874622524955520:12345-0@lo:103: Request processed in 131us (1942us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779448.560833:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787779448.560964:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855b01e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c28aae66-2825-42c5-8f52-61f687e868c9:3306:1874622524955520:0@lo:103: 00010000:00010000:3.0:1787779448.568503:0:6695:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:3.0:1787779448.569099:0:6695:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1787779448.572845:0:6695:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1787779448.573672:0:6695:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1787779448.582965:0:6695:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1787779448.583671:0:6695:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1787779448.585574:0:6695:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1787779448.585588:0:6695:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787779448.585595:0:6695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787779448.585597:0:6695:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1787779448.585601:0:6695:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787779448.585605:0:6695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787779448.585606:0:6695:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787779448.585609:0:6695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787779448.585611:0:6695:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787779448.585664:0:6695:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787779448.585668:0:6695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787779448.585669:0:6695:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787779448.585672:0:6695:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1787779448.586990:0:6677:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1787779448.587030:0:6677:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787779448.587056:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e841648a00/0x9e63ba8af6888d92 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888d99 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779448.587069:0:6677:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff98e841648a00/0x9e63ba8af6888d92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888d99 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787779448.587076:0:6677:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98e848ee5800 from 1 10000000:01000000:2.0:1787779448.587080:0:6677:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787779448.587116:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e841649600/0x9e63ba8af6888dae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779448.587124:0:6677:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff98e841649600/0x9e63ba8af6888dae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779448.587134:0:6677:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff98e841649600/0x9e63ba8af6888dae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779448.587157:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855b3f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:6677:1874622524955648:0@lo:101: 00000100:00100000:2.0:1787779448.587233:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779448.587273:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e849095e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787779448.588011:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524955648 00000100:00100000:1.0:1787779448.588020:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524955648 00000100:00100000:1.0:1787779448.588076:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787779448.588085:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ebf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+11:6677:x1874622524955648:12345-0@lo:101: 00010000:00010000:1.0:1787779448.588100:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779448.588113:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e8429d5000/0x9e63ba8af6888db5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9e63ba8af6888dae expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779448.588139:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e8429d5000/0x9e63ba8af6888db5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9e63ba8af6888dae expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779448.588157:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e8429d5000/0x9e63ba8af6888db5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af6888dae expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779448.588165:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e8429d5000, rc 0) 00000100:00100000:1.0:1787779448.588223:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ebf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+12:6677:x1874622524955648:12345-0@lo:101: Request processed in 140us (990us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779448.588230:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787779448.588629:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855b3f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:6677:1874622524955648:0@lo:101: 00010000:00010000:2.0:1787779448.588641:0:6677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff98e841649600/0x9e63ba8af6888dae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888db5 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779448.588648:0:6677:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff98e841649600/0x9e63ba8af6888dae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9e63ba8af6888db5 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779448.588773:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855b3f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:6677:1874622524955776:0@lo:501: 00000100:00100000:2.0:1787779448.588813:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779448.588841:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e849095e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787779448.589177:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524955776 00000100:00100000:1.0:1787779448.589183:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524955776 00000100:00100000:1.0:1787779448.589206:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787779448.589213:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ebe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+12:6677:x1874622524955776:12345-0@lo:501: 00000100:00100000:1.0:1787779448.589439:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ebe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+12:6677:x1874622524955776:12345-0@lo:501: Request processed in 225us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779448.589446:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787779448.589511:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855b3f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:6677:1874622524955776:0@lo:501: 00000100:00100000:2.0:1787779448.589540:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855b3f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:6677:1874622524955904:0@lo:503: 00000100:00100000:2.0:1787779448.589576:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779448.589605:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e849095e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787779448.589653:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524955904 00000100:00100000:0.0:1787779448.589657:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524955904 00000100:00100000:0.0:1787779448.589689:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787779448.589697:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ebd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+12:6677:x1874622524955904:12345-0@lo:503: 00000100:00100000:0.0:1787779448.589932:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ebd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+12:6677:x1874622524955904:12345-0@lo:503: Request processed in 235us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779448.589938:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787779448.590085:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855b3f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:6677:1874622524955904:0@lo:503: 00000040:00080000:2.0:1787779448.590470:0:6677:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787779448.590528:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855b3f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:6677:1874622524956032:0@lo:502: 00000100:00100000:2.0:1787779448.590563:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779448.590593:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e849095e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787779448.590697:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524956032 00000100:00100000:0.0:1787779448.590701:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524956032 00000100:00100000:0.0:1787779448.590750:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787779448.590757:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ebe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+12:6677:x1874622524956032:12345-0@lo:502: 00000100:00100000:0.0:1787779448.590868:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ebe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+12:6677:x1874622524956032:12345-0@lo:502: Request processed in 111us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779448.590873:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787779448.597793:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855b3f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:6677:1874622524956032:0@lo:502: 00000040:00080000:2.0:1787779448.598201:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1787779448.598264:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1787779448.598303:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855b3f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:6677:1874622524956160:0@lo:502: 00000100:00100000:2.0:1787779448.598709:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779448.598793:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e849095e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787779448.599066:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524956160 00000100:00100000:1.0:1787779448.599073:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524956160 00000100:00100000:1.0:1787779448.599117:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787779448.599125:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ebd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+12:6677:x1874622524956160:12345-0@lo:502: 00000100:00100000:1.0:1787779448.600126:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ebd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+12:6677:x1874622524956160:12345-0@lo:502: Request processed in 1000us (1415us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779448.600135:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787779448.600580:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855b3f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:6677:1874622524956160:0@lo:502: 00000040:00080000:2.0:1787779448.600752:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1787779448.600766:0:6677:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1787779448.602963:0:6699:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787779448.602976:0:6699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787779448.602979:0:6699:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787779448.602986:0:6699:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98e848ee5800 00000020:00000080:2.0:1787779448.602988:0:6699:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787779448.603011:0:6699:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787779448.603033:0:6699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787779448.603035:0:6699:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1787779448.603038:0:6699:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1787779448.603171:0:6677:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1787779448.603201:0:6677:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787779448.603221:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e841649600/0x9e63ba8af6888dae lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888db5 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779448.603233:0:6677:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff98e841649600/0x9e63ba8af6888dae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888db5 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787779448.603280:0:6677:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787779448.603283:0:6677:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98e848ee5800 10000000:01000000:0.0:1787779448.603286:0:6677:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98e848ee5800 10000000:01000000:0.0:1787779448.603290:0:6677:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787779448.603295:0:6677:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98e848ee5800 from 1 10000000:01000000:0.0:1787779448.603297:0:6677:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787779448.603342:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e840030200/0x9e63ba8af6888dbc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779448.603350:0:6677:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff98e840030200/0x9e63ba8af6888dbc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779448.603361:0:6677:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff98e840030200/0x9e63ba8af6888dbc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779448.603381:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855b03c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:6677:1874622524956288:0@lo:101: 00000100:00100000:0.0:1787779448.603450:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779448.603489:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e844cce480 going to sleep for 11 seconds 00000100:00100000:2.0:1787779448.603688:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524956288 00000100:00100000:2.0:1787779448.603695:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524956288 00000100:00100000:2.0:1787779448.603762:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787779448.603772:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ebc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+12:6677:x1874622524956288:12345-0@lo:101: 00010000:00010000:2.0:1787779448.603785:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779448.603798:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e841648e00/0x9e63ba8af6888dc3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9e63ba8af6888dbc expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779448.603821:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e841648e00/0x9e63ba8af6888dc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9e63ba8af6888dbc expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779448.603832:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e841648e00/0x9e63ba8af6888dc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af6888dbc expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779448.603840:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e841648e00, rc 0) 00000100:00100000:2.0:1787779448.603879:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ebc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+13:6677:x1874622524956288:12345-0@lo:101: Request processed in 109us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779448.604005:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855b03c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:6677:1874622524956288:0@lo:101: 00010000:00010000:0.0:1787779448.604019:0:6677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff98e840030200/0x9e63ba8af6888dbc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888dc3 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779448.604027:0:6677:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff98e840030200/0x9e63ba8af6888dbc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9e63ba8af6888dc3 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779448.604113:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855b03c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:6677:1874622524956416:0@lo:501: 00000100:00100000:0.0:1787779448.604139:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779448.604171:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524956416 00000100:00100000:0.0:1787779448.604175:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524956416 00000100:00100000:2.0:1787779448.604216:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787779448.604964:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787779448.604974:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ebf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+13:6677:x1874622524956416:12345-0@lo:501: 00000100:00100000:0.0:1787779448.605397:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ebf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+13:6677:x1874622524956416:12345-0@lo:501: Request processed in 423us (1256us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779448.605404:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787779448.605599:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e844cce480 going to sleep for 11 seconds 00000100:00100000:0.0:1787779448.605616:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855b03c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:6677:1874622524956416:0@lo:501: 00000100:00100000:0.0:1787779448.605650:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855b03c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:6677:1874622524956544:0@lo:503: 00000100:00100000:0.0:1787779448.605689:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779448.605810:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e844cce480 going to sleep for 11 seconds 00000100:00100000:2.0:1787779448.605977:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524956544 00000100:00100000:2.0:1787779448.605983:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524956544 00000100:00100000:2.0:1787779448.606099:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787779448.606169:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ebe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+13:6677:x1874622524956544:12345-0@lo:503: 00000100:00100000:2.0:1787779448.606564:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ebe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+13:6677:x1874622524956544:12345-0@lo:503: Request processed in 456us (873us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779448.606571:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787779448.606665:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855b03c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:6677:1874622524956544:0@lo:503: 00000040:00080000:2.0:1787779448.608602:0:6677:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787779448.608696:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855b3f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:6677:1874622524956672:0@lo:502: 00000100:00100000:2.0:1787779448.609165:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779448.609220:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e8490b6000 going to sleep for 11 seconds 00000100:00100000:0.0:1787779448.609374:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524956672 00000100:00100000:0.0:1787779448.609381:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524956672 00000100:00100000:0.0:1787779448.609438:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787779448.609447:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ebec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+13:6677:x1874622524956672:12345-0@lo:502: 00000100:00100000:0.0:1787779448.609688:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ebec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+13:6677:x1874622524956672:12345-0@lo:502: Request processed in 242us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779448.609696:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787779448.610078:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855b3f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:6677:1874622524956672:0@lo:502: 00000040:00080000:2.0:1787779448.610408:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1787779448.610473:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1787779448.610507:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1787779448.610553:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1787779448.610593:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1787779448.610653:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1787779448.610706:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1787779448.610781:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1787779448.610832:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1787779448.610867:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1787779448.611186:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1787779448.611241:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1787779448.611276:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1787779448.611309:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1787779448.611351:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1787779448.611383:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1787779448.611607:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1787779448.611659:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1787779448.611692:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1787779448.612060:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1787779448.612334:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1787779448.612374:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1787779448.612531:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1787779448.612585:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1787779448.612623:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1787779448.612657:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1787779448.612705:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1787779448.613071:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1787779448.613244:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855b3f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:6677:1874622524956800:0@lo:502: 00000100:00100000:2.0:1787779448.613329:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779448.613423:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e8490b6000 going to sleep for 11 seconds 00000100:00100000:0.0:1787779448.617066:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524956800 00000100:00100000:0.0:1787779448.617085:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524956800 00000100:00100000:1.0:1787779448.617229:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787779448.617239:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ebc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+13:6677:x1874622524956800:12345-0@lo:502: 00000100:00100000:1.0:1787779448.617757:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ebc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+13:6677:x1874622524956800:12345-0@lo:502: Request processed in 518us (4427us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779448.617766:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787779448.618016:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855b3f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:6677:1874622524956800:0@lo:502: 00000040:00080000:2.0:1787779448.618137:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1787779448.618153:0:6677:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1787779448.619016:0:6700:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787779448.619044:0:6700:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff98e87f03b370) 00000020:00000080:0.0:1787779448.619065:0:6700:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:0.0:1787779448.619144:0:6700:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98e848ee5800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787779448.619149:0:6700:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98e848ee5800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787779448.619157:0:6700:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98e848ee5800 3 00010000:00080000:0.0:1787779448.619200:0:6700:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98e848ee7800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.109@tcp at head 00010000:00010000:0.0:1787779448.622146:0:6700:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:0.0:1787779448.623108:0:6700:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1787779448.623149:0:6700:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787779448.623163:0:6700:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x9e63ba8af6888dd1 00000100:00080000:0.0:1787779448.623175:0:6700:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787779448.623273:0:6700:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98e848ee7800 using connection 192.168.201.109@tcp/0@lo 00000100:00100000:0.0:1787779448.623323:0:6700:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98e855b03c00 x1874622524956928/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787779448.623354:0:6700:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787779448.624498:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787779448.624516:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855b3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874622524957056:0@lo:400: 00000100:00100000:2.0:1787779448.624588:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779448.624659:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524957056 00000100:00100000:2.0:1787779448.624665:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524957056 00000100:00100000:2.0:1787779448.624707:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787779448.624733:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e855b3cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874622524957056:12345-0@lo:400: 00000100:00100000:2.0:1787779448.624782:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e855b3cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874622524957056:12345-0@lo:400: Request processed in 52us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779448.624789:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787779448.624830:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98e855b3f480 x1874622524957056/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779464 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779448.624843:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855b3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874622524957056:0@lo:400: 00000100:00100000:1.0:1787779448.625270:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855b03c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1874622524956928:0@lo:38: 00000100:00100000:1.0:1787779448.625310:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779448.625360:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524956928 00000100:00100000:1.0:1787779448.625365:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524956928 00000100:00100000:1.0:1787779448.625387:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787779448.625392:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e8521112c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3303:x1874622524956928:12345-0@lo:38: 00010000:00080000:1.0:1787779448.625428:0:5836:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 214 last 0 00000020:00000080:1.0:1787779448.625462:0:5836:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x9e63ba8af6888dd8 00000004:00100000:1.0:1787779448.625477:0:5836:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787779448.625505:0:5836:0:(import.c:65:import_set_state_nolock()) ffff98e85ff68800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787779448.625547:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e8521112c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874622524956928:12345-0@lo:38: Request processed in 153us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779448.625553:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787779448.625582:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98e855b03c00 x1874622524956928/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787779458 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779448.625590:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787779448.625596:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1787779448.625603:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787779448.625607:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787779448.625609:0:3303:0:(import.c:65:import_set_state_nolock()) ffff98e848ee7800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787779448.625615:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855b03c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1874622524956928:0@lo:38: 00000040:00080000:0.0:1787779448.626449:0:6700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:2.0:1787779448.627024:0:6677:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1787779448.627048:0:6677:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787779448.627064:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e840030200/0x9e63ba8af6888dbc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888dc3 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779448.627076:0:6677:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff98e840030200/0x9e63ba8af6888dbc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888dc3 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787779448.627136:0:6677:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787779448.627138:0:6677:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787779448.627139:0:6677:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787779448.627140:0:6677:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787779448.627141:0:6677:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787779448.627142:0:6677:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787779448.627144:0:6677:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787779448.627145:0:6677:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787779448.627146:0:6677:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787779448.627148:0:6677:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787779448.627149:0:6677:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787779448.627153:0:6677:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1787779448.627155:0:6677:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787779448.627156:0:6677:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787779448.627157:0:6677:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787779448.627158:0:6677:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787779448.627159:0:6677:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787779448.627160:0:6677:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787779448.627161:0:6677:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787779448.627162:0:6677:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787779448.627163:0:6677:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787779448.627164:0:6677:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787779448.627165:0:6677:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787779448.627210:0:6677:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787779448.627229:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855b3f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:6677:1874622524957184:0@lo:253: 00000100:00100000:2.0:1787779448.627296:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779448.627342:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e8490b6000 going to sleep for 11 seconds 00000100:00100000:1.0:1787779448.630616:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524957184 00000100:00100000:1.0:1787779448.630632:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524957184 00000100:00100000:1.0:1787779448.630693:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787779448.630703:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ebd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+13:6677:x1874622524957184:12345-0@lo:253: 20000000:01000000:1.0:1787779448.630759:0:5828:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787779448.630783:0:5828:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787779448.680856:0:5828:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787779448.680877:0:5828:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1787779448.681037:0:5851:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787779448.681042:0:5851:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787779448.681067:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98e8429d4c00/0x9e63ba8af6888ddf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779448.681087:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98e841649000/0x9e63ba8af6888d37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af6888d30 expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779448.681097:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98e8429d4c00/0x9e63ba8af6888ddf lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779448.681139:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98e841649000/0x9e63ba8af6888d37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9e63ba8af6888d30 expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779448.681155:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98e841649000/0x9e63ba8af6888d37 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9e63ba8af6888d30 expref: 13 pid: 5830 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779448.681170:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e852111680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5851:1874622524957312:0@lo:104: 00000100:00100000:1.0:1787779448.681244:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779448.681550:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e849095e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787779448.682543:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524957312 00000100:00100000:0.0:1787779448.682553:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524957312 00000100:00100000:0.0:1787779448.682644:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787779448.682654:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e852113480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c28aae66-2825-42c5-8f52-61f687e868c9+3:5851:x1874622524957312:12345-0@lo:104: 00010000:00010000:0.0:1787779448.682670:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.109@tcp lock: ffff98e8429d4400/0x9e63ba8af6888d30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9e63ba8af6888d37 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779448.682769:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787779448.682775:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e852113480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c28aae66-2825-42c5-8f52-61f687e868c9+3:5851:x1874622524957312:12345-0@lo:104: Request processed in 123us (1531us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779448.682782:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787779448.682856:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e852111680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5851:1874622524957312:0@lo:104: 00010000:00010000:2.0:1787779448.682880:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98e8429d4c00/0x9e63ba8af6888ddf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779448.689661:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ebd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+13:6677:x1874622524957184:12345-0@lo:253: Request processed in 58951us (62355us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779448.689679:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787779448.689808:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855b3f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:6677:1874622524957184:0@lo:253: 10000000:01000000:2.0:1787779448.689840:0:6677:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787779448.689842:0:6677:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787779448.689844:0:6677:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787779448.689845:0:6677:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787779448.689847:0:6677:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787779448.689848:0:6677:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787779448.689849:0:6677:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787779448.689850:0:6677:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787779448.689852:0:6677:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787779448.689853:0:6677:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787779448.689854:0:6677:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787779448.689855:0:6677:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787779448.689874:0:6677:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1787779448.690341:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787779448.690351:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff98e8429d4400/0x9e63ba8af6888d30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9e63ba8af6888d37 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779448.690362:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e8429d4400 already unused, calling callback (ffffffffc1cd5c20) 10000000:00010000:1.0:1787779448.690366:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff98e8429d4400/0x9e63ba8af6888d30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9e63ba8af6888d37 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779448.690376:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff98e8429d4400/0x9e63ba8af6888d30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9e63ba8af6888d37 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787779448.690396:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff98e8429d4400/0x9e63ba8af6888d30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9e63ba8af6888d37 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787779448.690401:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787779448.690574:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.109@tcp lock: ffff98e8429d4400/0x9e63ba8af6888d30 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af6888d37 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779448.690582:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787779448.690607:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff98e8429d4400/0x9e63ba8af6888d30 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af6888d37 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779448.690614:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff98e8429d4400/0x9e63ba8af6888d30 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af6888d37 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779448.690635:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779448.690637:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779448.690639:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779448.690653:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e852112940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c28aae66-2825-42c5-8f52-61f687e868c9:3305:1874622524957440:0@lo:103: 00000100:00100000:1.0:1787779448.690707:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779448.690798:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524957440 00000100:00100000:1.0:1787779448.690804:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524957440 00010000:00010000:1.0:1787779448.690829:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98e841649000/0x9e63ba8af6888d37 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9e63ba8af6888d30 expref: 13 pid: 5830 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779448.690855:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787779448.690864:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e848f00450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c28aae66-2825-42c5-8f52-61f687e868c9+13:3305:x1874622524957440:12345-0@lo:103: 00010000:00010000:1.0:1787779448.690877:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787779448.691388:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98e841649000/0x9e63ba8af6888d37 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9e63ba8af6888d30 expref: 13 pid: 5830 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779448.691542:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98e841649000/0x9e63ba8af6888d37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9e63ba8af6888d30 expref: 13 pid: 5830 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779448.691559:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e841649000/0x9e63ba8af6888d37 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9e63ba8af6888d30 expref: 13 pid: 5830 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779448.691574:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98e8429d4c00/0x9e63ba8af6888ddf lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779448.691582:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e8429d4c00/0x9e63ba8af6888ddf lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787779448.691599:0:5821:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010557410s 00010000:00010000:1.0:1787779448.691604:0:5821:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98e8429d4c00/0x9e63ba8af6888ddf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779448.691611:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98e8429d4c00/0x9e63ba8af6888ddf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779448.691618:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98e8429d4c00/0x9e63ba8af6888ddf lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779448.691624:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98e8429d4c00/0x9e63ba8af6888ddf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779448.691630:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e8429d4c00 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:1.0:1787779448.691633:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98e8429d4c00/0x9e63ba8af6888ddf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779448.691641:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98e8429d4c00/0x9e63ba8af6888ddf lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779448.691672:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98e8429d4c00/0x9e63ba8af6888ddf lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779448.691683:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787779448.691759:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e848f00450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c28aae66-2825-42c5-8f52-61f687e868c9+12:3305:x1874622524957440:12345-0@lo:103: Request processed in 895us (1051us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779448.691769:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787779448.691866:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e852112940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c28aae66-2825-42c5-8f52-61f687e868c9:3305:1874622524957440:0@lo:103: 00010000:00010000:3.0:1787779448.692503:0:5851:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98e8429d4c00/0x9e63ba8af6888ddf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779448.692514:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98e8429d4c00/0x9e63ba8af6888ddf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779448.692522:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e8429d4c00/0x9e63ba8af6888ddf lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:2.0:1787779448.698707:0:6677:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1787779448.699048:0:6677:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787779448.699510:0:6677:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1787779448.699681:0:6677:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787779448.700139:0:6677:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1787779448.700638:0:6677:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1787779448.702311:0:6677:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1787779448.983212:0:6677:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1787779448.983219:0:6677:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1787779448.983256:0:6677:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787779448.983316:0:6677:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.109@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787779448.983331:0:6677:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1787779448.983364:0:6677:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1787779449.398985:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779450.419086:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779451.444636:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787779452.019346:0:5833:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787779452.019357:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98e846b05800 from 21 10000000:01000000:1.0:1787779452.019363:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787779452.019430:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e8429d5200/0x9e63ba8af6888de6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779452.019444:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff98e8429d5200/0x9e63ba8af6888de6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779452.019456:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff98e8429d5200/0x9e63ba8af6888de6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779452.019488:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e852112940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524957568:0@lo:101: 00000100:00100000:1.0:1787779452.019585:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779452.019656:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e847383600 going to sleep for 11 seconds 00000100:00100000:0.0:1787779452.022025:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524957568 00000100:00100000:0.0:1787779452.022047:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524957568 00000100:00100000:0.0:1787779452.022142:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787779452.022155:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+12:5833:x1874622524957568:12345-0@lo:101: 00010000:00010000:0.0:1787779452.022178:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787779452.022207:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e840030000/0x9e63ba8af6888ded lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9e63ba8af6888de6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779452.022249:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e840030000/0x9e63ba8af6888ded lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9e63ba8af6888de6 expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779452.022263:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e840030000/0x9e63ba8af6888ded lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af6888de6 expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779452.022275:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e840030000, rc 0) 00000100:00100000:0.0:1787779452.022388:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+13:5833:x1874622524957568:12345-0@lo:101: Request processed in 236us (2802us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779452.022396:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787779452.022517:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e852112940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524957568:0@lo:101: 00010000:00010000:0.0:1787779452.022540:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff98e8429d5200/0x9e63ba8af6888de6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888ded expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779452.022551:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff98e8429d5200/0x9e63ba8af6888de6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9e63ba8af6888ded expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779452.022640:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855b00f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524957696:0@lo:501: 00000100:00100000:0.0:1787779452.022704:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779452.022767:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e852470480 going to sleep for 11 seconds 00000100:00100000:3.0:1787779452.023221:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524957696 00000100:00100000:3.0:1787779452.023236:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524957696 00000100:00100000:3.0:1787779452.023284:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787779452.023293:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+13:5833:x1874622524957696:12345-0@lo:501: 00000100:00100000:0.0:1787779452.024646:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855b00f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524957696:0@lo:501: 00000100:00100000:0.0:1787779452.024735:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855b00f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524957824:0@lo:503: 00000100:00100000:0.0:1787779452.024805:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779452.025180:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+13:5833:x1874622524957696:12345-0@lo:501: Request processed in 530us (1118us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779452.025199:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787779452.025248:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524957824 00000100:00100000:3.0:1787779452.025254:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524957824 00000100:00100000:3.0:1787779452.025290:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787779452.025298:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+13:5833:x1874622524957824:12345-0@lo:503: 00000100:00100000:3.0:1787779452.025691:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+13:5833:x1874622524957824:12345-0@lo:503: Request processed in 392us (884us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779452.025699:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787779452.026085:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e852470480 going to sleep for 11 seconds 00000100:00100000:0.0:1787779452.026190:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855b00f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524957824:0@lo:503: 00000100:00100000:0.0:1787779452.027291:0:6849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855b00f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c28aae66-2825-42c5-8f52-61f687e868c9:6849:1874622524957952:0@lo:502: 00000100:00100000:0.0:1787779452.027379:0:6849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779452.027430:0:6849:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e8450ff540 going to sleep for 11 seconds 00000100:00100000:1.0:1787779452.027752:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524957952 00000100:00100000:1.0:1787779452.027761:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524957952 00000100:00100000:1.0:1787779452.027817:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787779452.027827:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+13:6849:x1874622524957952:12345-0@lo:502: 00000100:00100000:1.0:1787779452.031241:0:6849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855b00f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c28aae66-2825-42c5-8f52-61f687e868c9:6849:1874622524957952:0@lo:502: 00000100:00100000:1.0:1787779452.031366:0:6849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e8521121c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c28aae66-2825-42c5-8f52-61f687e868c9:6849:1874622524958080:0@lo:502: 00000100:00100000:0.0:1787779452.031450:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+13:6849:x1874622524957952:12345-0@lo:502: Request processed in 3622us (4069us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779452.031466:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787779452.031566:0:6849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779452.031650:0:6849:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e847383cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787779452.031692:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524958080 00000100:00100000:0.0:1787779452.031699:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524958080 00000100:00100000:0.0:1787779452.031905:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787779452.031917:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+13:6849:x1874622524958080:12345-0@lo:502: 00000100:00100000:0.0:1787779452.032384:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+13:6849:x1874622524958080:12345-0@lo:502: Request processed in 466us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779452.032393:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787779452.032465:0:6849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e8521121c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c28aae66-2825-42c5-8f52-61f687e868c9:6849:1874622524958080:0@lo:502: 00000040:00080000:1.0:1787779452.032497:0:6849:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1787779452.032935:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1787779452.033036:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787779452.033053:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e8429d5200/0x9e63ba8af6888de6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888ded expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779452.033067:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff98e8429d5200/0x9e63ba8af6888de6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888ded expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787779452.033093:0:5833:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787779452.033096:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98e846b05800 from 4 10000000:01000000:0.0:1787779452.033100:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787779452.033597:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e840031a00/0x9e63ba8af6888df4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779452.033608:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff98e840031a00/0x9e63ba8af6888df4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779452.033620:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff98e840031a00/0x9e63ba8af6888df4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779452.033643:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855b00000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524958208:0@lo:101: 00000100:00100000:0.0:1787779452.033704:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779452.033889:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e845ef5c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787779452.034048:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524958208 00000100:00100000:1.0:1787779452.034056:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524958208 00000100:00100000:1.0:1787779452.034207:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787779452.034220:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+13:5833:x1874622524958208:12345-0@lo:101: 00010000:00010000:1.0:1787779452.034238:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779452.034261:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e8429d5c00/0x9e63ba8af6888dfb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9e63ba8af6888df4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779452.034292:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e8429d5c00/0x9e63ba8af6888dfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9e63ba8af6888df4 expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779452.034306:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e8429d5c00/0x9e63ba8af6888dfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af6888df4 expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779452.034318:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e8429d5c00, rc 0) 00000100:00100000:1.0:1787779452.034378:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+14:5833:x1874622524958208:12345-0@lo:101: Request processed in 160us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779452.034386:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787779452.034467:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855b00000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524958208:0@lo:101: 00010000:00010000:2.0:1787779452.034484:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff98e840031a00/0x9e63ba8af6888df4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888dfb expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779452.034494:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff98e840031a00/0x9e63ba8af6888df4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9e63ba8af6888dfb expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779452.034558:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855b3ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524958336:0@lo:256: 00000100:00100000:2.0:1787779452.034597:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779452.034704:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e8480b3900 going to sleep for 11 seconds 00000100:00100000:0.0:1787779452.035010:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524958336 00000100:00100000:0.0:1787779452.035016:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524958336 00000100:00100000:0.0:1787779452.035045:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787779452.035052:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+14:5833:x1874622524958336:12345-0@lo:256: 20000000:01000000:0.0:1787779452.035070:0:5830:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787779452.035090:0:5830:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787779452.035093:0:5830:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1787779452.035184:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+14:5833:x1874622524958336:12345-0@lo:256: Request processed in 132us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779452.035192:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787779452.035224:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855b3ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524958336:0@lo:256: 10000000:01000000:0.0:1787779452.035270:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787779452.035283:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e840031a00/0x9e63ba8af6888df4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888dfb expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779452.035293:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff98e840031a00/0x9e63ba8af6888df4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888dfb expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787779452.035302:0:5833:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787779452.035305:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1787779452.035307:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787779452.035327:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e840031800/0x9e63ba8af6888e02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779452.035335:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff98e840031800/0x9e63ba8af6888e02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779452.035344:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff98e840031800/0x9e63ba8af6888e02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779452.035357:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855b012c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524958464:0@lo:101: 00000100:00100000:0.0:1787779452.035383:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779452.035397:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e8469a29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787779452.035409:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524958464 00000100:00100000:0.0:1787779452.035412:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524958464 00000100:00100000:0.0:1787779452.035428:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787779452.035434:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+14:5833:x1874622524958464:12345-0@lo:101: 00010000:00010000:0.0:1787779452.035441:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787779452.035472:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e848f69600/0x9e63ba8af6888e09 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9e63ba8af6888e02 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779452.035491:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e848f69600/0x9e63ba8af6888e09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9e63ba8af6888e02 expref: 15 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779452.035509:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e848f69600/0x9e63ba8af6888e09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af6888e02 expref: 15 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779452.035517:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e848f69600, rc 0) 00000100:00100000:0.0:1787779452.035548:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+15:5833:x1874622524958464:12345-0@lo:101: Request processed in 114us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779452.035554:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787779452.035581:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855b012c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524958464:0@lo:101: 00010000:00010000:0.0:1787779452.035592:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff98e840031800/0x9e63ba8af6888e02 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888e09 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779452.035600:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff98e840031800/0x9e63ba8af6888e02 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9e63ba8af6888e09 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779452.035647:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855b012c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524958592:0@lo:501: 00000100:00100000:0.0:1787779452.035668:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779452.035678:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e8469a29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787779452.035688:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524958592 00000100:00100000:0.0:1787779452.035691:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524958592 00000100:00100000:0.0:1787779452.035704:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787779452.035730:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+15:5833:x1874622524958592:12345-0@lo:501: 00000100:00100000:0.0:1787779452.036035:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+15:5833:x1874622524958592:12345-0@lo:501: Request processed in 325us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779452.036042:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787779452.036079:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855b012c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524958592:0@lo:501: 00000100:00100000:0.0:1787779452.036106:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855b012c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524958720:0@lo:503: 00000100:00100000:0.0:1787779452.036144:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779452.036155:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e8450a9d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787779452.036165:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524958720 00000100:00100000:0.0:1787779452.036168:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524958720 00000100:00100000:0.0:1787779452.036182:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787779452.036187:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+15:5833:x1874622524958720:12345-0@lo:503: 00000100:00100000:0.0:1787779452.036498:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+15:5833:x1874622524958720:12345-0@lo:503: Request processed in 308us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779452.036505:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787779452.036538:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855b012c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524958720:0@lo:503: 00000100:00100000:0.0:1787779452.036765:0:6851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855b012c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c28aae66-2825-42c5-8f52-61f687e868c9:6851:1874622524958848:0@lo:502: 00000100:00100000:0.0:1787779452.036796:0:6851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779452.036812:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524958848 00000100:00100000:0.0:1787779452.036815:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524958848 00000100:00100000:0.0:1787779452.036830:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787779452.036835:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+15:6851:x1874622524958848:12345-0@lo:502: 00000100:00100000:0.0:1787779452.037023:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+15:6851:x1874622524958848:12345-0@lo:502: Request processed in 187us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779452.037030:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787779452.037054:0:6851:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e8450a9900 going to sleep for 11 seconds 00000100:00100000:0.0:1787779452.037063:0:6851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855b012c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c28aae66-2825-42c5-8f52-61f687e868c9:6851:1874622524958848:0@lo:502: 00000020:01000000:0.0:1787779452.037082:0:6851:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787779452.037091:0:6851:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1787779452.037099:0:6851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787779452.037102:0:6851:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1787779452.037107:0:6851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787779452.037115:0:6851:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.109@tcp to nid 0x20000c0a8c96d (192.168.201.109@tcp) 00000020:01000000:0.0:1787779452.037142:0:6851:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787779452.037144:0:6851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787779452.037163:0:6851:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff98e87f0399b8) 00000020:00000080:0.0:1787779452.037184:0:6851:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1787779452.037188:0:6851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787779452.037268:0:6851:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1787779452.037274:0:6851:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:0.0:1787779452.037282:0:6851:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9e63ba8af6888e17 00010000:00080000:0.0:1787779452.037319:0:6851:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98e85fdcd000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.109@tcp at head 00010000:00010000:0.0:1787779452.037592:0:6851:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1787779452.105612:0:6851:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1787779452.105650:0:6851:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787779452.106609:0:6851:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787779452.107144:0:6851:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787779452.107199:0:6851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1787779452.107272:0:6851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1787779452.117840:0:6853:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787779452.117862:0:6853:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1787779452.132947:0:6851:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787779452.132972:0:6851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787779452.133034:0:6851:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1787779452.133066:0:6851:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9e63ba8af6888e1e 00000100:00080000:3.0:1787779452.133084:0:6851:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787779452.133093:0:6851:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff98e85fdcd000 using connection 192.168.201.109@tcp/0@lo 00000100:00100000:3.0:1787779452.133151:0:6851:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98e855a63c00 x1874622524958976/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787779452.133186:0:6851:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:3.0:1787779452.133294:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855a612c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874622524959104:0@lo:400: 00000100:00100000:1.0:1787779452.133338:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855a63c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874622524958976:0@lo:8: 00000100:00100000:0.0:1787779452.136608:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855a62d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874622524959232:0@lo:400: 00000020:01000000:2.0:1787779452.138124:0:6851:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787779452.138137:0:6851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787779452.138139:0:6851:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1787779452.138145:0:6851:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787779452.138150:0:6851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787779452.138152:0:6851:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787779452.138155:0:6851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787779452.138157:0:6851:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787779452.138218:0:6851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855b3f840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c28aae66-2825-42c5-8f52-61f687e868c9:6851:1874622524959360:0@lo:502: 00000100:00100000:1.0:1787779452.142249:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779452.142653:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779452.142740:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524959104 00000100:00100000:3.0:1787779452.142752:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524959104 00000100:00100000:3.0:1787779452.142813:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787779452.142839:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e855a60b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874622524959104:12345-0@lo:400: 00000100:00100000:3.0:1787779452.142974:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e855a60b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874622524959104:12345-0@lo:400: Request processed in 150us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779452.142983:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787779452.143126:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98e855a612c0 x1874622524959104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779468 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779452.143143:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855a612c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874622524959104:0@lo:400: 00000100:00100000:0.0:1787779452.143343:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779452.145667:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524959232 00000100:00100000:3.0:1787779452.145686:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524959232 00000100:00100000:3.0:1787779452.145834:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787779452.145848:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e855b012c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874622524959232:12345-0@lo:400: 00000100:00100000:3.0:1787779452.145999:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e855b012c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874622524959232:12345-0@lo:400: Request processed in 154us (2656us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779452.146007:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1787779452.146099:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98e855a62d00 x1874622524959232/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779468 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779452.146118:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855a62d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874622524959232:0@lo:400: 00000100:00080000:0.0:1787779452.146645:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787779452.146800:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524958976 00000100:00100000:0.0:1787779452.146807:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524958976 00000100:00100000:0.0:1787779452.146855:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787779452.146863:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e8521121c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3303:x1874622524958976:12345-0@lo:8: 00010000:00080000:0.0:1787779452.146908:0:6680:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 217 last 0 00000020:00000080:0.0:1787779452.146951:0:6680:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9e63ba8af6888e25 00002000:00100000:0.0:1787779452.147020:0:6680:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff98e85fdca000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113939 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1787779452.147025:0:6680:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:0.0:1787779452.147031:0:6680:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1787779452.147224:0:6680:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787779452.147978:0:6680:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787779452.148023:0:6680:0:(import.c:65:import_set_state_nolock()) ffff98e85fdcb000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787779452.148587:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e8521121c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1874622524958976:12345-0@lo:8: Request processed in 1616us (6244us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779452.148600:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787779452.149294:0:6851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779452.149382:0:6851:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e87f0369c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787779452.150838:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524959360 00000100:00100000:0.0:1787779452.150855:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524959360 00000100:00100000:0.0:1787779452.151087:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787779452.151100:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+15:6851:x1874622524959360:12345-0@lo:502: 00000100:00100000:0.0:1787779452.152257:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+15:6851:x1874622524959360:12345-0@lo:502: Request processed in 1152us (2959us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779452.152274:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:1.0:1787779452.159151:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98e855a63c00 x1874622524958976/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787779462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779452.159173:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787779452.159188:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1787779452.159200:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787779452.161330:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1787779452.161338:0:3303:0:(import.c:65:import_set_state_nolock()) ffff98e85fdcd000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787779452.161359:0:3303:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787779452.161372:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855a63c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874622524958976:0@lo:8: 00000004:00080000:1.0:1787779452.161420:0:6853:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1787779452.161782:0:6851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855b3f840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c28aae66-2825-42c5-8f52-61f687e868c9:6851:1874622524959360:0@lo:502: 00000020:01000000:3.0:1787779452.162160:0:6851:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787779452.162172:0:6851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787779452.162175:0:6851:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787779452.162182:0:6851:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:3.0:1787779452.162268:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1787779452.162288:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787779452.162302:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e840031800/0x9e63ba8af6888e02 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888e09 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779452.162328:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff98e840031800/0x9e63ba8af6888e02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888e09 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787779452.162341:0:5833:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1787779452.162344:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff98e842f18000 from 1 10000000:01000000:3.0:1787779452.162348:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00000004:00080000:1.0:1787779452.162790:0:6853:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 217904075860ns, next at 0ns, rc = 0 00010000:00010000:3.0:1787779452.166063:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e882049400/0x9e63ba8af6888e2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779452.166089:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff98e882049400/0x9e63ba8af6888e2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779452.166103:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff98e882049400/0x9e63ba8af6888e2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779452.166137:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855a62d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524959488:0@lo:101: 00000100:00100000:3.0:1787779452.166234:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779452.166309:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e8509b5a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787779452.166327:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524959488 00000100:00100000:1.0:1787779452.166337:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524959488 00000100:00100000:1.0:1787779452.166394:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787779452.166405:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+15:5833:x1874622524959488:12345-0@lo:101: 00010000:00010000:1.0:1787779452.166424:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779452.166440:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e8429d5800/0x9e63ba8af6888e33 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9e63ba8af6888e2c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779452.166473:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e8429d5800/0x9e63ba8af6888e33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9e63ba8af6888e2c expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779452.166501:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e8429d5800/0x9e63ba8af6888e33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af6888e2c expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779452.166513:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e8429d5800, rc 0) 00000100:00100000:1.0:1787779452.166561:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+16:5833:x1874622524959488:12345-0@lo:101: Request processed in 158us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779452.166568:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787779452.180819:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855a62d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524959488:0@lo:101: 00010000:00010000:2.0:1787779452.180873:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff98e882049400/0x9e63ba8af6888e2c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888e33 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779452.180897:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff98e882049400/0x9e63ba8af6888e2c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9e63ba8af6888e33 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779452.181005:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855b3c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524959616:0@lo:501: 00000100:00100000:2.0:1787779452.181093:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779452.181160:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e87f036a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787779452.181377:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524959616 00000100:00100000:0.0:1787779452.181384:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524959616 00000100:00100000:0.0:1787779452.181449:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787779452.181462:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e844dc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+16:5833:x1874622524959616:12345-0@lo:501: 00000100:00100000:0.0:1787779452.181984:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e844dc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+16:5833:x1874622524959616:12345-0@lo:501: Request processed in 523us (889us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787779452.181994:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787779452.182309:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855b3c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524959616:0@lo:501: 10000000:01000000:2.0:1787779452.182360:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787779452.182372:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e882049400/0x9e63ba8af6888e2c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888e33 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779452.182385:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff98e882049400/0x9e63ba8af6888e2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888e33 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787779452.279105:0:5857:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:1.0:1787779452.279297:0:6855:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1787779452.279334:0:6855:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e852112940 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6855:1874622524959872:0@lo:7: 00000100:00100000:1.0:1787779452.279430:0:6855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779452.279505:0:6855:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e847383600 going to sleep for 11 seconds 00000100:00100000:1.0:1787779452.279530:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787779452.279543:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e852113840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874622524959744:0@lo:13: 00000100:00100000:1.0:1787779452.279575:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779452.279638:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524959872 00000100:00100000:0.0:1787779452.279650:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524959872 00000100:00100000:0.0:1787779452.279749:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1787779452.279754:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787779452.279760:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e852111680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6855:x1874622524959872:12345-0@lo:7: 00000100:00100000:1.0:1787779452.281691:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524959744 00000100:00100000:1.0:1787779452.281708:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524959744 00000100:00100000:1.0:1787779452.281801:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787779452.281813:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e8521130c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1874622524959744:12345-0@lo:13: 00002000:00000024:1.0:1787779452.281871:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1787779452.281991:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e8521130c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1874622524959744:12345-0@lo:13: Request processed in 180us (2413us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779452.282000:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787779452.282065:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98e852113840 x1874622524959744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779468 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779452.282094:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e852113840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874622524959744:0@lo:13: 00002000:00080000:2.0:1787779452.301491:0:6682:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1787779452.301504:0:6682:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1787779452.301706:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e852111680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6855:x1874622524959872:12345-0@lo:7: Request processed in 21940us (22269us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779452.301751:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787779452.306008:0:6855:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98e852112940 x1874622524959872/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787779468 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779452.306034:0:6855:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e852112940 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6855:1874622524959872:0@lo:7: 00000004:00080000:1.0:1787779452.306058:0:6855:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1787779452.310415:0:6855:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855b3c780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6855:1874622524960000:0@lo:5: 00000100:00100000:2.0:1787779452.310526:0:6855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779452.310634:0:6855:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e848e73840 going to sleep for 11 seconds 00000100:00100000:1.0:1787779452.316511:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524960000 00000100:00100000:1.0:1787779452.316537:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524960000 00000100:00100000:1.0:1787779452.316631:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787779452.316644:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e855b3f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6855:x1874622524960000:12345-0@lo:5: 00002000:00080000:1.0:1787779452.316733:0:6681:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1787779452.316739:0:6681:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1787779452.318518:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e855b3f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6855:x1874622524960000:12345-0@lo:5: Request processed in 1867us (7982us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1787779452.318534:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787779452.319526:0:6855:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98e855b3c780 x1874622524960000/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787779468 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779452.319554:0:6855:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855b3c780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6855:1874622524960000:0@lo:5: 00000004:00080000:0.0:1787779452.319595:0:6855:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1787779452.319651:0:6855:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855b02d00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6855:1874622524960128:0@lo:700: 00000100:00100000:0.0:1787779452.319733:0:6855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779452.319783:0:6855:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e8450a96c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787779452.320386:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524960128 00000100:00100000:1.0:1787779452.320403:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524960128 00000100:00100000:1.0:1787779452.320475:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787779452.320490:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e855b02940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6855:x1874622524960128:12345-0@lo:700: 00000100:00100000:1.0:1787779452.320546:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e852112940 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6688:1874622524960256:0@lo:700: 00000100:00100000:1.0:1787779452.320602:0:6688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779452.320636:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e847383600 going to sleep for 11 seconds 00000100:00100000:2.0:1787779452.326538:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524960256 00000100:00100000:2.0:1787779452.326563:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524960256 00000100:00100000:2.0:1787779452.326636:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787779452.326648:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e852113840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6688:x1874622524960256:12345-0@lo:700: 40000000:02000000:1.0:1787779452.413455:0:5842:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:0.0:1787779452.420297:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e852113840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6688:x1874622524960256:12345-0@lo:700: Request processed in 93638us (99681us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779452.420327:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787779452.420503:0:6688:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98e852112940 x1874622524960256/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787779468 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779452.420524:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e852112940 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6688:1874622524960256:0@lo:700: 40000000:02000000:1.0:1787779452.420542:0:6688:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00010000:00010000:1.0:1787779452.470387:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787779452.534444:0:6704:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1787779452.534475:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000100:00100000:1.0:1787779452.534927:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e855b02940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6855:x1874622524960128:12345-0@lo:700: Request processed in 214430us (215184us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779452.534946:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787779452.534962:0:6855:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98e855b02d00 x1874622524960128/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787779468 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779452.534981:0:6855:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1787779452.535009:0:6855:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855b02d00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6855:1874622524960128:0@lo:700: 00000004:02000040:0.0:1787779452.580152:0:6855:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:2.0:1787779452.591921:0:6855:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855b3ed00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6855:1874622524960384:0@lo:5: 00000100:00100000:2.0:1787779452.592033:0:6855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779452.592116:0:6855:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e848e733c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787779452.593289:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524960384 00000100:00100000:0.0:1787779452.593304:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524960384 00000100:00100000:0.0:1787779452.593485:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787779452.593496:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e855b3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6855:x1874622524960384:12345-0@lo:5: 00002000:00080000:1.0:1787779452.608559:0:6682:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1787779452.608582:0:6682:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:1.0:1787779452.611763:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e855b3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6855:x1874622524960384:12345-0@lo:5: Request processed in 18261us (19723us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1787779452.611779:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787779452.612171:0:6855:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98e855b3ed00 x1874622524960384/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787779468 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779452.612203:0:6855:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855b3ed00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6855:1874622524960384:0@lo:5: 00000004:00080000:2.0:1787779452.612226:0:6855:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:0.0:1787779453.491056:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779454.516266:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779455.539238:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787779455.750018:0:7047:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg109-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787779456.563944:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779457.459183:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787779457.465921:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855b003c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c28aae66-2825-42c5-8f52-61f687e868c9:3306:1874622524960640:0@lo:400: 00000100:00100000:3.0:1787779457.466005:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779457.468889:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855b3cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874622524960512:0@lo:13: 00000100:00100000:2.0:1787779457.468956:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779457.469023:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855b00f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874622524960896:0@lo:400: 00000100:00100000:1.0:1787779457.469126:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855b00b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874622524961024:0@lo:400: 00000100:00100000:1.0:1787779457.469155:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779457.469187:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524961024 00000100:00100000:1.0:1787779457.469194:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524961024 00000100:00100000:1.0:1787779457.469254:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787779457.469262:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e852112940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1874622524961024:12345-0@lo:400: 00000100:00100000:1.0:1787779457.469428:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e852112940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1874622524961024:12345-0@lo:400: Request processed in 166us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779457.469436:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1787779457.469457:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787779457.469595:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98e855b00b40 x1874622524961024/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779473 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779457.469610:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855b00b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874622524961024:0@lo:400: 00000100:00100000:2.0:1787779457.470613:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779457.471332:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524960512 00000100:00100000:0.0:1787779457.471341:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524960512 00000100:00100000:0.0:1787779457.471386:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787779457.471396:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e855b3e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1874622524960512:12345-0@lo:13: 00002000:00000024:0.0:1787779457.471445:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787779457.471854:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e855b3e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1874622524960512:12345-0@lo:13: Request processed in 459us (2897us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779457.471862:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787779457.474686:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98e855b3cf00 x1874622524960512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779473 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779457.474747:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855b3cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874622524960512:0@lo:13: 00000100:00100000:3.0:1787779457.479055:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787779457.479077:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855b00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874622524960768:0@lo:400: 00000100:00100000:3.0:1787779457.479146:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779457.479220:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524960896 00000100:00100000:3.0:1787779457.479230:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524960896 00000100:00100000:3.0:1787779457.480388:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524960768 00000100:00100000:3.0:1787779457.480399:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524960768 00000100:00100000:3.0:1787779457.480445:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787779457.480457:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e855b3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874622524960896:12345-0@lo:400: 00000100:00100000:3.0:1787779457.481410:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e855b3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874622524960896:12345-0@lo:400: Request processed in 951us (10792us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779457.481422:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787779457.481450:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787779457.481459:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e855a621c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874622524960768:12345-0@lo:400: 00000100:00100000:3.0:1787779457.482148:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e855a621c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874622524960768:12345-0@lo:400: Request processed in 688us (2999us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779457.482159:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1787779457.482874:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98e855b00000 x1874622524960768/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779473 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779457.482890:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855b00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874622524960768:0@lo:400: 00010000:00080000:3.0:1787779457.482932:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98e855b00f00 x1874622524960896/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779473 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779457.482943:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855b00f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874622524960896:0@lo:400: 00000100:00080000:3.0:1787779457.511284:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787779457.511309:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524960640 00000100:00100000:3.0:1787779457.511320:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524960640 00000100:00100000:3.0:1787779457.511377:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787779457.511387:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e844dc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+16:3306:x1874622524960640:12345-0@lo:400: 00000100:00100000:3.0:1787779457.511484:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e844dc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+16:3306:x1874622524960640:12345-0@lo:400: Request processed in 99us (45480us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779457.511501:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787779457.511567:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855b003c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c28aae66-2825-42c5-8f52-61f687e868c9:3306:1874622524960640:0@lo:400: 00010000:00010000:1.0:1787779457.590900:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787779457.616874:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:1.0:1787779458.612371:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779459.634969:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779460.658974:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779461.683624:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779462.579175:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855a60f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874622524961408:0@lo:400: 00000100:00100000:3.0:1787779462.579252:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779462.579319:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787779462.579326:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855a603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874622524961536:0@lo:400: 00000100:00100000:3.0:1787779462.579360:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779462.579403:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524961408 00000100:00100000:3.0:1787779462.579410:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524961408 00000100:00100000:3.0:1787779462.579465:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787779462.579476:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e855a612c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874622524961408:12345-0@lo:400: 00000100:00100000:3.0:1787779462.579543:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e855a612c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874622524961408:12345-0@lo:400: Request processed in 68us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779462.579550:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787779462.579580:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524961536 00000100:00100000:3.0:1787779462.579584:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524961536 00000100:00100000:3.0:1787779462.579611:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787779462.579618:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e855a62d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874622524961536:12345-0@lo:400: 00000100:00100000:3.0:1787779462.579649:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e855a62d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874622524961536:12345-0@lo:400: Request processed in 32us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779462.579654:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1787779462.579672:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787779462.580628:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855a60780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874622524961280:0@lo:400: 00000100:00100000:1.0:1787779462.580750:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779462.580786:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787779462.580793:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855a62940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c28aae66-2825-42c5-8f52-61f687e868c9:3307:1874622524961152:0@lo:400: 00000100:00100000:1.0:1787779462.580824:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779462.580852:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855a63840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622524961664:0@lo:13: 00000100:00100000:1.0:1787779462.580878:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779462.580919:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524961664 00000100:00100000:1.0:1787779462.580925:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524961664 00000100:00100000:1.0:1787779462.580957:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787779462.580966:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ece4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622524961664:12345-0@lo:13: 00002000:00000024:1.0:1787779462.581000:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787779462.581042:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ece4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622524961664:12345-0@lo:13: Request processed in 77us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779462.581049:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787779462.581087:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98e855a63840 x1874622524961664/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779478 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779462.581098:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1787779462.581122:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855a63840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622524961664:0@lo:13: 00000100:00100000:2.0:1787779462.582057:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524961152 00000100:00100000:2.0:1787779462.582067:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524961152 00000100:00100000:2.0:1787779462.582121:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787779462.582131:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e844dc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+16:3307:x1874622524961152:12345-0@lo:400: 00000100:00100000:2.0:1787779462.582192:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e844dc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+16:3307:x1874622524961152:12345-0@lo:400: Request processed in 63us (1367us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779462.582198:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787779462.582243:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855a62940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c28aae66-2825-42c5-8f52-61f687e868c9:3307:1874622524961152:0@lo:400: 00000100:00080000:3.0:1787779462.583072:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787779462.583102:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524961280 00000100:00100000:3.0:1787779462.583111:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524961280 00000100:00100000:3.0:1787779462.583150:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787779462.583167:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ece4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874622524961280:12345-0@lo:400: 00000100:00100000:3.0:1787779462.583244:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ece4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874622524961280:12345-0@lo:400: Request processed in 79us (2494us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779462.583250:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1787779462.583303:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98e855a603c0 x1874622524961536/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779478 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779462.583317:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855a603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874622524961536:0@lo:400: 00010000:00080000:3.0:1787779462.583330:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98e855a60f00 x1874622524961408/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779478 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779462.583339:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855a60f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874622524961408:0@lo:400: 00010000:00080000:0.0:1787779462.584799:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98e855a60780 x1874622524961280/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779478 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779462.584827:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855a60780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874622524961280:0@lo:400: 00010000:00010000:1.0:1787779462.706854:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779463.730909:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779464.756085:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779465.789373:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787779466.833319:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779467.699399:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ece4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874622524961920:0@lo:400: 00000100:00100000:0.0:1787779467.699458:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ece7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c28aae66-2825-42c5-8f52-61f687e868c9:3307:1874622524961792:0@lo:400: 00000100:00100000:3.0:1787779467.699474:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779467.699499:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779467.699630:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524961920 00000100:00100000:1.0:1787779467.699639:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524961920 00000100:00100000:2.0:1787779467.699668:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ece5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622524962176:0@lo:400: 00000100:00100000:1.0:1787779467.699700:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787779467.699705:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779467.699735:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e855a63c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874622524961920:12345-0@lo:400: 00000100:00100000:1.0:1787779467.699803:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e855a63c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874622524961920:12345-0@lo:400: Request processed in 92us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779467.699821:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787779467.699934:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524962176 00000100:00100000:2.0:1787779467.699941:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524962176 00000100:00100000:2.0:1787779467.699991:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787779467.700001:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e855b3e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622524962176:12345-0@lo:400: 00010000:00080000:3.0:1787779467.700267:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98e87ece4b40 x1874622524961920/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779483 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779467.700283:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ece4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874622524961920:0@lo:400: 00000100:00100000:3.0:1787779467.700306:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787779467.700315:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ece7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874622524962048:0@lo:400: 00000100:00100000:2.0:1787779467.700315:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e855b3e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622524962176:12345-0@lo:400: Request processed in 304us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779467.700326:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787779467.700398:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779467.700975:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855a603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622524962304:0@lo:13: 00000100:00100000:3.0:1787779467.701015:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524961792 00000100:00100000:3.0:1787779467.701021:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524961792 00000100:00100000:0.0:1787779467.701029:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779467.701189:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524962304 00000100:00100000:1.0:1787779467.701194:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524962304 00000100:00100000:1.0:1787779467.701218:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787779467.701225:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e855b01e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622524962304:12345-0@lo:13: 00002000:00000024:1.0:1787779467.701255:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787779467.701299:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e855b01e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622524962304:12345-0@lo:13: Request processed in 74us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779467.701313:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787779467.701354:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787779467.701359:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842effc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+16:3307:x1874622524961792:12345-0@lo:400: 00000100:00100000:3.0:1787779467.701389:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842effc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+16:3307:x1874622524961792:12345-0@lo:400: Request processed in 31us (1893us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779467.701401:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787779467.701509:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ece7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c28aae66-2825-42c5-8f52-61f687e868c9:3307:1874622524961792:0@lo:400: 00010000:00080000:0.0:1787779467.701523:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98e855a603c0 x1874622524962304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779483 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779467.701532:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524962048 00000100:00100000:3.0:1787779467.701536:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524962048 00000100:00100000:0.0:1787779467.701541:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855a603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622524962304:0@lo:13: 00000100:00100000:3.0:1787779467.701636:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787779467.701646:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e855a61e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874622524962048:12345-0@lo:400: 00000100:00100000:3.0:1787779467.701698:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e855a61e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874622524962048:12345-0@lo:400: Request processed in 55us (1300us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779467.701706:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1787779467.701746:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787779467.701751:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787779467.702067:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98e87ece5a40 x1874622524962176/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779483 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779467.702075:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ece5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622524962176:0@lo:400: 00010000:00080000:0.0:1787779467.702312:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98e87ece7480 x1874622524962048/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779483 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779467.702323:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ece7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874622524962048:0@lo:400: 00010000:00010000:1.0:1787779467.891086:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787779468.915224:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787779469.001934:0:7617:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787779469.001939:0:7617:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1787779469.002179:0:7617:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff98e87a56c800 00000020:01000004:2.0:1787779469.002196:0:7617:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1787779469.002269:0:7617:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1787779469.002284:0:7617:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff98e844cb99b8) 00000020:00000080:2.0:1787779469.002309:0:7617:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787779469.040976:0:7617:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1787779469.043169:0:7617:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1787779469.083854:0:7617:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1787779469.090879:0:7617:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787779469.090925:0:7617:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1787779469.090983:0:7617:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787779469.091009:0:7617:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1787779469.091487:0:7617:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1787779469.091501:0:7617:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787779469.091512:0:7617:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9e63ba8af6888e41 00000020:01000004:3.0:1787779469.091521:0:7617:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1787779469.092469:0:7617:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.109@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787779469.092476:0:7617:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.109@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787779469.092494:0:7617:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1787779469.092527:0:7617:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1787779469.092533:0:7617:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.109@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1787779469.132696:0:7617:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.109@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787779469.132810:0:7617:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.109@tcp, index=0001, flags=0x20062 00000020:01000004:1.0:1787779469.132815:0:7617:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787779469.132817:0:7617:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787779469.132818:0:7617:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787779469.132820:0:7617:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787779469.132821:0:7617:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787779469.132822:0:7617:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787779469.132824:0:7617:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787779469.132825:0:7617:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787779469.132826:0:7617:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787779469.132828:0:7617:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787779469.132829:0:7617:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787779469.132834:0:7617:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:1.0:1787779469.132836:0:7617:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787779469.132837:0:7617:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787779469.132839:0:7617:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787779469.132840:0:7617:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787779469.132841:0:7617:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787779469.132842:0:7617:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787779469.132843:0:7617:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787779469.132844:0:7617:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787779469.132845:0:7617:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787779469.132847:0:7617:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787779469.132848:0:7617:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787779469.132877:0:7617:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1787779469.132896:0:7617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ece43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:7617:1874622524962432:0@lo:253: 00000100:00100000:1.0:1787779469.132987:0:7617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779469.133035:0:7617:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e849115300 going to sleep for 11 seconds 00000100:00100000:2.0:1787779469.133412:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524962432 00000100:00100000:2.0:1787779469.133420:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524962432 00000100:00100000:2.0:1787779469.133478:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787779469.133488:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842efcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+16:7617:x1874622524962432:12345-0@lo:253: 20000000:01000000:2.0:1787779469.133539:0:5830:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1787779469.133551:0:5830:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1787779469.133557:0:5830:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1787779469.133561:0:5830:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:2.0:1787779469.135475:0:5830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787779469.136238:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1787779469.136260:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:2.0:1787779469.136320:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1787779469.136329:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:2.0:1787779469.136358:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1787779469.136411:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1787779469.138020:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1787779469.138054:0:5830:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.109@tcp 20000000:01000000:2.0:1787779469.138057:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.109@tcp (null) (null) (null) 00000040:00080000:2.0:1787779469.138099:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1787779469.138108:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787779469.138159:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1787779469.138167:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.201.109@tcp (null) (null) 00000040:00080000:2.0:1787779469.138200:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1787779469.139795:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1787779469.139893:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1787779469.139993:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1787779469.144152:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:2.0:1787779469.144185:0:5830:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.109@tcp 20000000:01000000:2.0:1787779469.144193:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.109@tcp (null) (null) (null) 00000040:00080000:2.0:1787779469.144233:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:2.0:1787779469.144243:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1787779469.144275:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:2.0:1787779469.144282:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.201.109@tcp (null) (null) 00000040:00080000:2.0:1787779469.144312:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:2.0:1787779469.144322:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1787779469.144367:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:2.0:1787779469.144412:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:2.0:1787779469.144430:0:5830:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:2.0:1787779469.144432:0:5830:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1787779469.144436:0:5830:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1787779469.144459:0:5830:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787779469.144462:0:5830:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1787779469.144500:0:5830:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1787779469.144502:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787779469.149131:0:7619:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1787779469.149239:0:7619:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1787779469.149271:0:7619:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:2.0:1787779469.149915:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:2.0:1787779469.149988:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:2.0:1787779469.150045:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:2.0:1787779469.150060:0:5830:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787779469.150063:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787779469.157273:0:7620:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:2.0:1787779469.157373:0:7620:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:2.0:1787779469.157446:0:7620:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1787779469.157941:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:3.0:1787779469.157988:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:3.0:1787779469.158019:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:3.0:1787779469.158031:0:5830:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787779469.158034:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787779469.159524:0:7621:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:3.0:1787779469.159897:0:7621:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:3.0:1787779469.160006:0:7621:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1787779469.161160:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1787779469.161209:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1787779469.161276:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1787779469.161291:0:5830:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1787779469.161294:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787779469.162114:0:7622:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1787779469.162573:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1787779469.162642:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1787779469.163016:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1787779469.163039:0:5830:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:0.0:1787779469.163041:0:5830:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:0.0:1787779469.163051:0:5830:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787779469.163070:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98e848f68c00/0x9e63ba8af6888e48 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779469.163090:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98e8429d4e00/0x9e63ba8af6888d99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af6888d92 expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779469.163116:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98e841648e00/0x9e63ba8af6888dc3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af6888dbc expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779469.163122:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98e840030000/0x9e63ba8af6888ded lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af6888de6 expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779469.163129:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98e848f69600/0x9e63ba8af6888e09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af6888e02 expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779469.163136:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98e8429d5800/0x9e63ba8af6888e33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af6888e2c expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779469.163144:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98e848f68c00/0x9e63ba8af6888e48 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779469.163184:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98e8429d5800/0x9e63ba8af6888e33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9e63ba8af6888e2c expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779469.163201:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98e8429d5800/0x9e63ba8af6888e33 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9e63ba8af6888e2c expref: 16 pid: 5828 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779469.163216:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855b03c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5830:1874622524962560:0@lo:104: 00000100:00100000:0.0:1787779469.163292:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787779469.163392:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98e848f69600/0x9e63ba8af6888e09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9e63ba8af6888e02 expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779469.163401:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98e848f69600/0x9e63ba8af6888e09 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9e63ba8af6888e02 expref: 16 pid: 5830 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779469.163409:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855b02d00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5830:1874622524962688:0@lo:104: 00010000:00010000:0.0:1787779469.163442:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98e840030000/0x9e63ba8af6888ded lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9e63ba8af6888de6 expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779469.163450:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98e840030000/0x9e63ba8af6888ded lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9e63ba8af6888de6 expref: 16 pid: 5830 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779469.163458:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855b003c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5830:1874622524962816:0@lo:104: 00010000:00010000:0.0:1787779469.163479:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98e841648e00/0x9e63ba8af6888dc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9e63ba8af6888dbc expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779469.163486:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98e841648e00/0x9e63ba8af6888dc3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9e63ba8af6888dbc expref: 16 pid: 5831 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779469.163493:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855b00f00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5830:1874622524962944:0@lo:104: 00010000:00010000:0.0:1787779469.163513:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98e8429d4e00/0x9e63ba8af6888d99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9e63ba8af6888d92 expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779469.163521:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98e8429d4e00/0x9e63ba8af6888d99 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9e63ba8af6888d92 expref: 16 pid: 5830 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779469.163528:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855b00000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5830:1874622524963072:0@lo:104: 00000100:00100000:0.0:1787779469.163556:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e87eb42840 going to sleep for 11 seconds 00000100:00100000:3.0:1787779469.165394:0:5819:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787779469.165460:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779469.165575:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779469.168388:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779469.172803:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524962560 00000100:00100000:1.0:1787779469.172841:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524962560 00000100:00100000:1.0:1787779469.172903:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524962688 00000100:00100000:1.0:1787779469.172907:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524962688 00000100:00100000:1.0:1787779469.172917:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524962816 00000100:00100000:1.0:1787779469.172919:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524962816 00000100:00100000:1.0:1787779469.172936:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787779469.172946:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e851656c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c28aae66-2825-42c5-8f52-61f687e868c9+5:5830:x1874622524962560:12345-0@lo:104: 00010000:00010000:1.0:1787779469.172969:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.109@tcp lock: ffff98e882049400/0x9e63ba8af6888e2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9e63ba8af6888e33 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779469.173096:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787779469.173101:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e851656c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c28aae66-2825-42c5-8f52-61f687e868c9+5:5830:x1874622524962560:12345-0@lo:104: Request processed in 158us (9810us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779469.173108:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787779469.173162:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787779469.173169:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e855a62580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c28aae66-2825-42c5-8f52-61f687e868c9+4:5830:x1874622524962688:12345-0@lo:104: 00010000:00010000:1.0:1787779469.173176:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.109@tcp lock: ffff98e840031800/0x9e63ba8af6888e02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9e63ba8af6888e09 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779469.173222:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787779469.173228:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e855a62580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c28aae66-2825-42c5-8f52-61f687e868c9+4:5830:x1874622524962688:12345-0@lo:104: Request processed in 61us (7771us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779469.173234:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787779469.173246:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787779469.173252:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e855a63480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c28aae66-2825-42c5-8f52-61f687e868c9+3:5830:x1874622524962816:12345-0@lo:104: 00010000:00010000:1.0:1787779469.173260:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.109@tcp lock: ffff98e8429d5200/0x9e63ba8af6888de6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9e63ba8af6888ded expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779469.173286:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787779469.173296:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e855a63480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c28aae66-2825-42c5-8f52-61f687e868c9+3:5830:x1874622524962816:12345-0@lo:104: Request processed in 45us (7721us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779469.173302:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1787779469.173331:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787779469.173337:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff98e882049400/0x9e63ba8af6888e2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9e63ba8af6888e33 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779469.173344:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e882049400 already unused, calling callback (ffffffffc1cd5c20) 10000000:00010000:1.0:1787779469.173348:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff98e882049400/0x9e63ba8af6888e2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x9e63ba8af6888e33 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779469.173356:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff98e882049400/0x9e63ba8af6888e2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x9e63ba8af6888e33 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787779469.173363:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff98e882049400/0x9e63ba8af6888e2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x9e63ba8af6888e33 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787779469.173368:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787779469.173423:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.109@tcp lock: ffff98e882049400/0x9e63ba8af6888e2c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af6888e33 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779469.173429:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787779469.173448:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff98e882049400/0x9e63ba8af6888e2c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af6888e33 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779469.173455:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff98e882049400/0x9e63ba8af6888e2c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af6888e33 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779469.173470:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787779469.173473:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff98e840031800/0x9e63ba8af6888e02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9e63ba8af6888e09 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779469.173487:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e840031800 already unused, calling callback (ffffffffc1cd5c20) 10000000:00010000:1.0:1787779469.173490:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff98e840031800/0x9e63ba8af6888e02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x9e63ba8af6888e09 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779469.173497:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff98e840031800/0x9e63ba8af6888e02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x9e63ba8af6888e09 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787779469.173503:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff98e840031800/0x9e63ba8af6888e02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x9e63ba8af6888e09 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787779469.173508:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787779469.173522:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.109@tcp lock: ffff98e840031800/0x9e63ba8af6888e02 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af6888e09 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779469.173527:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787779469.173532:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff98e840031800/0x9e63ba8af6888e02 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af6888e09 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779469.173538:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff98e840031800/0x9e63ba8af6888e02 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af6888e09 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779469.173559:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787779469.173562:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff98e8429d5200/0x9e63ba8af6888de6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9e63ba8af6888ded expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779469.173568:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e8429d5200 already unused, calling callback (ffffffffc1cd5c20) 10000000:00010000:1.0:1787779469.173570:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff98e8429d5200/0x9e63ba8af6888de6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9e63ba8af6888ded expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779469.173597:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff98e8429d5200/0x9e63ba8af6888de6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9e63ba8af6888ded expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787779469.173604:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff98e8429d5200/0x9e63ba8af6888de6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9e63ba8af6888ded expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787779469.173616:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787779469.173630:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.109@tcp lock: ffff98e8429d5200/0x9e63ba8af6888de6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af6888ded expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779469.173636:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787779469.173648:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff98e8429d5200/0x9e63ba8af6888de6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af6888ded expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779469.173655:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff98e8429d5200/0x9e63ba8af6888de6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af6888ded expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779469.173665:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779469.173667:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779469.173668:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779469.173806:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ece4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c28aae66-2825-42c5-8f52-61f687e868c9:3304:1874622524963200:0@lo:103: 00000100:00100000:0.0:1787779469.173853:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779469.173892:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787779469.173898:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ece5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c28aae66-2825-42c5-8f52-61f687e868c9:3304:1874622524963328:0@lo:103: 00000100:00100000:0.0:1787779469.173918:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779469.173940:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787779469.173955:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ece52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c28aae66-2825-42c5-8f52-61f687e868c9:3307:1874622524963456:0@lo:103: 00000100:00100000:0.0:1787779469.173977:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779469.174006:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524963200 00000100:00100000:0.0:1787779469.174011:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524963200 00010000:00010000:0.0:1787779469.174034:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98e8429d5800/0x9e63ba8af6888e33 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9e63ba8af6888e2c expref: 17 pid: 5828 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779469.174051:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524963328 00000100:00100000:0.0:1787779469.174054:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524963328 00010000:00010000:0.0:1787779469.174064:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98e848f69600/0x9e63ba8af6888e09 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9e63ba8af6888e02 expref: 18 pid: 5830 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779469.174075:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524963456 00000100:00100000:0.0:1787779469.174077:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524963456 00010000:00010000:0.0:1787779469.174088:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98e840030000/0x9e63ba8af6888ded lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9e63ba8af6888de6 expref: 19 pid: 5830 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779469.174101:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787779469.174108:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e855b00b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c28aae66-2825-42c5-8f52-61f687e868c9+19:3304:x1874622524963200:12345-0@lo:103: 00010000:00010000:0.0:1787779469.174120:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787779469.174126:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98e8429d5800/0x9e63ba8af6888e33 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9e63ba8af6888e2c expref: 19 pid: 5828 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779469.174136:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98e8429d5800/0x9e63ba8af6888e33 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9e63ba8af6888e2c expref: 19 pid: 5828 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779469.174156:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787779469.174183:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e855b00b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c28aae66-2825-42c5-8f52-61f687e868c9+19:3304:x1874622524963200:12345-0@lo:103: Request processed in 76us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779469.174190:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787779469.174207:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787779469.174219:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e855b021c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c28aae66-2825-42c5-8f52-61f687e868c9+18:3304:x1874622524963328:12345-0@lo:103: 00010000:00010000:0.0:1787779469.174227:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787779469.174231:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98e848f69600/0x9e63ba8af6888e09 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9e63ba8af6888e02 expref: 18 pid: 5830 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779469.174239:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98e848f69600/0x9e63ba8af6888e09 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9e63ba8af6888e02 expref: 18 pid: 5830 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779469.174248:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787779469.174269:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e855b021c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c28aae66-2825-42c5-8f52-61f687e868c9+18:3304:x1874622524963328:12345-0@lo:103: Request processed in 50us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779469.174274:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787779469.174287:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787779469.174293:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e855b02580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c28aae66-2825-42c5-8f52-61f687e868c9+17:3307:x1874622524963456:12345-0@lo:103: 00010000:00010000:0.0:1787779469.174314:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787779469.174319:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98e840030000/0x9e63ba8af6888ded lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9e63ba8af6888de6 expref: 17 pid: 5830 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779469.174328:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98e840030000/0x9e63ba8af6888ded lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9e63ba8af6888de6 expref: 17 pid: 5830 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779469.174337:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787779469.174365:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e855b02580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c28aae66-2825-42c5-8f52-61f687e868c9+17:3307:x1874622524963456:12345-0@lo:103: Request processed in 73us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779469.174372:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787779469.174409:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ece52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c28aae66-2825-42c5-8f52-61f687e868c9:3307:1874622524963456:0@lo:103: 00000100:00100000:0.0:1787779469.174433:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ece5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c28aae66-2825-42c5-8f52-61f687e868c9:3304:1874622524963328:0@lo:103: 00000100:00100000:0.0:1787779469.174438:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ece4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c28aae66-2825-42c5-8f52-61f687e868c9:3304:1874622524963200:0@lo:103: 00010000:00010000:0.0:1787779469.174469:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e8429d5800/0x9e63ba8af6888e33 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9e63ba8af6888e2c expref: 16 pid: 5828 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779469.174480:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855b03c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5830:1874622524962560:0@lo:104: 00010000:00010000:0.0:1787779469.174490:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e848f69600/0x9e63ba8af6888e09 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9e63ba8af6888e02 expref: 15 pid: 5830 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779469.174497:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855b02d00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5830:1874622524962688:0@lo:104: 00010000:00010000:0.0:1787779469.174506:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e840030000/0x9e63ba8af6888ded lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9e63ba8af6888de6 expref: 14 pid: 5830 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779469.174513:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855b003c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5830:1874622524962816:0@lo:104: 00010000:00010000:0.0:1787779469.174787:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779469.176418:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779469.176440:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524962944 00000100:00100000:3.0:1787779469.176447:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524962944 00000100:00100000:3.0:1787779469.176489:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524963072 00000100:00100000:3.0:1787779469.176492:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524963072 00000100:00100000:3.0:1787779469.176507:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787779469.176515:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e855a603c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c28aae66-2825-42c5-8f52-61f687e868c9+4:5830:x1874622524962944:12345-0@lo:104: 00010000:00010000:3.0:1787779469.176534:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.109@tcp lock: ffff98e840030200/0x9e63ba8af6888dbc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9e63ba8af6888dc3 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779469.176647:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787779469.176665:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e855a603c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c28aae66-2825-42c5-8f52-61f687e868c9+4:5830:x1874622524962944:12345-0@lo:104: Request processed in 152us (8286us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779469.176672:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:3.0:1787779469.176693:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787779469.176699:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff98e840030200/0x9e63ba8af6888dbc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9e63ba8af6888dc3 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779469.176707:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e840030200 already unused, calling callback (ffffffffc1cd5c20) 10000000:00010000:3.0:1787779469.176737:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff98e840030200/0x9e63ba8af6888dbc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9e63ba8af6888dc3 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779469.176745:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff98e840030200/0x9e63ba8af6888dbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9e63ba8af6888dc3 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787779469.176752:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff98e840030200/0x9e63ba8af6888dbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9e63ba8af6888dc3 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787779469.176757:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787779469.176781:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.109@tcp lock: ffff98e840030200/0x9e63ba8af6888dbc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af6888dc3 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779469.176786:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787779469.176799:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff98e840030200/0x9e63ba8af6888dbc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af6888dc3 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779469.176805:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff98e840030200/0x9e63ba8af6888dbc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af6888dc3 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779469.176815:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787779469.176816:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787779469.176818:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779469.176842:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787779469.176848:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e855a60f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c28aae66-2825-42c5-8f52-61f687e868c9+3:5830:x1874622524963072:12345-0@lo:104: 00010000:00010000:3.0:1787779469.176855:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.109@tcp lock: ffff98e841648a00/0x9e63ba8af6888d92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9e63ba8af6888d99 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779469.176884:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787779469.176889:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e855a60f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c28aae66-2825-42c5-8f52-61f687e868c9+3:5830:x1874622524963072:12345-0@lo:104: Request processed in 41us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779469.176895:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787779469.177017:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787779469.177034:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855a60780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c28aae66-2825-42c5-8f52-61f687e868c9:3306:1874622524963584:0@lo:103: 00000100:00100000:0.0:1787779469.177074:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787779469.177113:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787779469.177119:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff98e841648a00/0x9e63ba8af6888d92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9e63ba8af6888d99 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779469.177125:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e841648a00 already unused, calling callback (ffffffffc1cd5c20) 10000000:00010000:0.0:1787779469.177128:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff98e841648a00/0x9e63ba8af6888d92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9e63ba8af6888d99 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779469.177135:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff98e841648a00/0x9e63ba8af6888d92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9e63ba8af6888d99 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787779469.177142:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff98e841648a00/0x9e63ba8af6888d92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9e63ba8af6888d99 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787779469.177154:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787779469.177182:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.109@tcp lock: ffff98e841648a00/0x9e63ba8af6888d92 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af6888d99 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779469.177188:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787779469.177202:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff98e841648a00/0x9e63ba8af6888d92 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af6888d99 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779469.177209:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff98e841648a00/0x9e63ba8af6888d92 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af6888d99 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779469.177232:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779469.177234:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779469.177236:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779469.177241:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787779469.177249:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87aa57840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c28aae66-2825-42c5-8f52-61f687e868c9:3305:1874622524963712:0@lo:103: 00000100:00100000:0.0:1787779469.177273:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779469.177298:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524963584 00000100:00100000:0.0:1787779469.177302:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524963584 00010000:00010000:0.0:1787779469.177318:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98e841648e00/0x9e63ba8af6888dc3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9e63ba8af6888dbc expref: 14 pid: 5831 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779469.177337:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524963712 00000100:00100000:0.0:1787779469.177340:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524963712 00010000:00010000:0.0:1787779469.177349:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98e8429d4e00/0x9e63ba8af6888d99 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9e63ba8af6888d92 expref: 15 pid: 5830 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779469.177360:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787779469.177366:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e855b03480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c28aae66-2825-42c5-8f52-61f687e868c9+15:3306:x1874622524963584:12345-0@lo:103: 00010000:00010000:0.0:1787779469.177385:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787779469.177390:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98e841648e00/0x9e63ba8af6888dc3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9e63ba8af6888dbc expref: 15 pid: 5831 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779469.177399:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98e841648e00/0x9e63ba8af6888dc3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9e63ba8af6888dbc expref: 15 pid: 5831 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779469.177416:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787779469.177442:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e855b03480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c28aae66-2825-42c5-8f52-61f687e868c9+15:3306:x1874622524963584:12345-0@lo:103: Request processed in 76us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779469.177449:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787779469.177462:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787779469.177468:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87aa570c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c28aae66-2825-42c5-8f52-61f687e868c9+14:3305:x1874622524963712:12345-0@lo:103: 00010000:00010000:0.0:1787779469.177474:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787779469.177479:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98e8429d4e00/0x9e63ba8af6888d99 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9e63ba8af6888d92 expref: 14 pid: 5830 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779469.177488:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98e8429d4e00/0x9e63ba8af6888d99 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9e63ba8af6888d92 expref: 14 pid: 5830 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779469.177499:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98e848f68c00/0x9e63ba8af6888e48 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779469.177506:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e848f68c00/0x9e63ba8af6888e48 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779469.177521:0:5822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98e848f68c00/0x9e63ba8af6888e48 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779469.177528:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98e848f68c00/0x9e63ba8af6888e48 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779469.177542:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98e848f68c00/0x9e63ba8af6888e48 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779469.177549:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98e848f68c00/0x9e63ba8af6888e48 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779469.177554:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e848f68c00 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:0.0:1787779469.177558:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98e848f68c00/0x9e63ba8af6888e48 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779469.177565:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98e848f68c00/0x9e63ba8af6888e48 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779469.177573:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98e848f68c00/0x9e63ba8af6888e48 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779469.177593:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787779469.177629:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87aa570c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c28aae66-2825-42c5-8f52-61f687e868c9+14:3305:x1874622524963712:12345-0@lo:103: Request processed in 160us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779469.177635:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787779469.177667:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87aa57840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c28aae66-2825-42c5-8f52-61f687e868c9:3305:1874622524963712:0@lo:103: 00000100:00100000:0.0:1787779469.177692:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855a60780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c28aae66-2825-42c5-8f52-61f687e868c9:3306:1874622524963584:0@lo:103: 00010000:00010000:0.0:1787779469.177746:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e841648e00/0x9e63ba8af6888dc3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9e63ba8af6888dbc expref: 13 pid: 5831 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779469.177756:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855b00f00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5830:1874622524962944:0@lo:104: 00010000:00010000:0.0:1787779469.177765:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e8429d4e00/0x9e63ba8af6888d99 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9e63ba8af6888d92 expref: 12 pid: 5830 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779469.177787:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855b00000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5830:1874622524963072:0@lo:104: 00010000:00010000:0.0:1787779469.177810:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98e848f68c00/0x9e63ba8af6888e48 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779469.177819:0:5830:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98e848f68c00/0x9e63ba8af6888e48 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779469.177824:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98e848f68c00/0x9e63ba8af6888e48 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779469.177830:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e848f68c00/0x9e63ba8af6888e48 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787779469.177842:0:5830:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1787779469.241489:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842efcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+11:7617:x1874622524962432:12345-0@lo:253: Request processed in 107992us (108492us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779469.241505:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787779469.241704:0:7617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ece43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:7617:1874622524962432:0@lo:253: 10000000:01000000:1.0:1787779469.241736:0:7617:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787779469.241740:0:7617:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787779469.241742:0:7617:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787779469.241743:0:7617:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787779469.241744:0:7617:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:1.0:1787779469.241745:0:7617:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787779469.241747:0:7617:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787779469.241748:0:7617:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787779469.241749:0:7617:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1787779469.241751:0:7617:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787779469.241766:0:7617:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787779469.241787:0:7617:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98e87a56c800 from lustre-OST0001 10000000:01000000:1.0:1787779469.241817:0:7617:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1787779469.241820:0:7617:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787779469.241829:0:7617:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff98e842f18000 local copy 10000000:01000000:1.0:1787779469.241833:0:7617:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787779469.241877:0:7617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e8429d5200/0x9e63ba8af6888e4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779469.241889:0:7617:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.109@tcp lock: ffff98e8429d5200/0x9e63ba8af6888e4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779469.241900:0:7617:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff98e8429d5200/0x9e63ba8af6888e4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779469.241919:0:7617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ece43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:7617:1874622524963840:0@lo:101: 00000100:00100000:1.0:1787779469.241960:0:7617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779469.242003:0:7617:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e8491153c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787779469.242083:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524963840 00000100:00100000:2.0:1787779469.242088:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524963840 00000100:00100000:2.0:1787779469.242140:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787779469.242149:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842efdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+11:7617:x1874622524963840:12345-0@lo:101: 00010000:00010000:2.0:1787779469.242161:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779469.242174:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e841649000/0x9e63ba8af6888e56 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9e63ba8af6888e4f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779469.242209:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e841649000/0x9e63ba8af6888e56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9e63ba8af6888e4f expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779469.242219:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e841649000/0x9e63ba8af6888e56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af6888e4f expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779469.242228:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e841649000, rc 0) 00000100:00100000:2.0:1787779469.242266:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842efdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+12:7617:x1874622524963840:12345-0@lo:101: Request processed in 118us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779469.242272:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787779469.242864:0:7617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ece43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:7617:1874622524963840:0@lo:101: 00010000:00010000:1.0:1787779469.242880:0:7617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff98e8429d5200/0x9e63ba8af6888e4f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x9e63ba8af6888e56 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779469.242889:0:7617:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff98e8429d5200/0x9e63ba8af6888e4f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x9e63ba8af6888e56 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779469.242990:0:7617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ece43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:7617:1874622524963968:0@lo:501: 00000100:00100000:1.0:1787779469.243021:0:7617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779469.243060:0:7617:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e8491153c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787779469.243109:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524963968 00000100:00100000:2.0:1787779469.243121:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524963968 00000100:00100000:2.0:1787779469.243152:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787779469.243159:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842efc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+12:7617:x1874622524963968:12345-0@lo:501: 00000100:00100000:2.0:1787779469.243390:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842efc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+12:7617:x1874622524963968:12345-0@lo:501: Request processed in 230us (366us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787779469.243397:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787779469.243655:0:7617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ece43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:7617:1874622524963968:0@lo:501: 10000000:01000000:1.0:1787779469.243671:0:7617:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.109@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787779469.243707:0:7617:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.109@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787779469.243742:0:7617:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e8429d5200/0x9e63ba8af6888e4f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x9e63ba8af6888e56 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779469.243749:0:7617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e8429d5200/0x9e63ba8af6888e4f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x9e63ba8af6888e56 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779469.243756:0:7617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.109@tcp lock: ffff98e8429d5200/0x9e63ba8af6888e4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x9e63ba8af6888e56 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779469.243774:0:7617:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787779469.243796:0:7617:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98e87a56c800 10000000:01000000:1.0:1787779469.243800:0:7617:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787779469.243806:0:7617:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787779469.243808:0:7617:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787779469.243812:0:7617:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1787779469.243814:0:7617:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787779469.243831:0:7617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e8429d5a00/0x9e63ba8af6888e5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779469.243838:0:7617:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff98e8429d5a00/0x9e63ba8af6888e5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779469.243846:0:7617:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff98e8429d5a00/0x9e63ba8af6888e5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779469.243856:0:7617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ece43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:7617:1874622524964096:0@lo:101: 00000100:00100000:1.0:1787779469.243883:0:7617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779469.243893:0:7617:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e849115180 going to sleep for 11 seconds 00010000:00010000:3.0:1787779469.243948:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787779469.243955:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff98e8429d5200/0x9e63ba8af6888e4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x9e63ba8af6888e56 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779469.243961:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e8429d5200 already unused, calling callback (ffffffffc1cd5c20) 10000000:00010000:3.0:1787779469.243964:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff98e8429d5200/0x9e63ba8af6888e4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x9e63ba8af6888e56 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779469.243972:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff98e8429d5200/0x9e63ba8af6888e4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x9e63ba8af6888e56 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787779469.243978:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff98e8429d5200/0x9e63ba8af6888e4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x9e63ba8af6888e56 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787779469.243983:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787779469.244001:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.109@tcp lock: ffff98e8429d5200/0x9e63ba8af6888e4f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x9e63ba8af6888e56 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779469.244006:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787779469.244033:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff98e8429d5200/0x9e63ba8af6888e4f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x9e63ba8af6888e56 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779469.244049:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff98e8429d5200/0x9e63ba8af6888e4f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x9e63ba8af6888e56 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779469.244061:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787779469.244063:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787779469.244064:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779469.244136:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524964096 00000100:00100000:0.0:1787779469.244141:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524964096 00000100:00100000:0.0:1787779469.244163:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787779469.244171:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842eff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+12:7617:x1874622524964096:12345-0@lo:101: 00010000:00010000:0.0:1787779469.244179:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787779469.244192:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e848f68c00/0x9e63ba8af6888e64 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9e63ba8af6888e5d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779469.244210:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e848f68c00/0x9e63ba8af6888e64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9e63ba8af6888e5d expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779469.244219:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e848f68c00/0x9e63ba8af6888e64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af6888e5d expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779469.244233:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e848f68c00, rc 0) 00000100:00100000:0.0:1787779469.244266:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842eff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+13:7617:x1874622524964096:12345-0@lo:101: Request processed in 95us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779469.244271:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787779469.244293:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787779469.244303:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855a62940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c28aae66-2825-42c5-8f52-61f687e868c9:3304:1874622524964224:0@lo:103: 00000100:00100000:0.0:1787779469.244327:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779469.244357:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524964224 00000100:00100000:0.0:1787779469.244361:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524964224 00000100:00100000:0.0:1787779469.244385:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787779469.244391:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87aa57840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c28aae66-2825-42c5-8f52-61f687e868c9+13:3304:x1874622524964224:12345-0@lo:103: 00010000:00010000:0.0:1787779469.244398:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787779469.244410:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e841649000/0x9e63ba8af6888e56 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9e63ba8af6888e4f expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779469.244420:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787779469.244444:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87aa57840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c28aae66-2825-42c5-8f52-61f687e868c9+12:3304:x1874622524964224:12345-0@lo:103: Request processed in 54us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779469.244450:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787779469.244475:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855a62940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c28aae66-2825-42c5-8f52-61f687e868c9:3304:1874622524964224:0@lo:103: 00000100:00100000:0.0:1787779469.244497:0:7617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ece43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:7617:1874622524964096:0@lo:101: 00010000:00010000:0.0:1787779469.244507:0:7617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff98e8429d5a00/0x9e63ba8af6888e5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888e64 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779469.244515:0:7617:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff98e8429d5a00/0x9e63ba8af6888e5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9e63ba8af6888e64 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779469.244896:0:7617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87aa54780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:7617:1874622524964352:0@lo:501: 00000100:00100000:0.0:1787779469.244924:0:7617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779469.244982:0:7617:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e87eb423c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787779469.246298:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524964352 00000100:00100000:3.0:1787779469.246306:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524964352 00000100:00100000:3.0:1787779469.246386:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787779469.246395:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842eff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+12:7617:x1874622524964352:12345-0@lo:501: 00000100:00100000:3.0:1787779469.246725:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842eff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+12:7617:x1874622524964352:12345-0@lo:501: Request processed in 315us (1783us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779469.246734:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787779469.246892:0:7617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87aa54780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:7617:1874622524964352:0@lo:501: 00000100:00100000:1.0:1787779469.246947:0:7617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ece6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:7617:1874622524964480:0@lo:503: 00000100:00100000:1.0:1787779469.246998:0:7617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779469.247031:0:7617:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e8491156c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787779469.248197:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524964480 00000100:00100000:3.0:1787779469.248209:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524964480 00000100:00100000:3.0:1787779469.248250:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787779469.248258:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842efe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+12:7617:x1874622524964480:12345-0@lo:503: 00000100:00100000:3.0:1787779469.248488:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842efe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+12:7617:x1874622524964480:12345-0@lo:503: Request processed in 230us (1489us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779469.248496:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787779469.248704:0:7617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ece6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:7617:1874622524964480:0@lo:503: 00000040:00080000:1.0:1787779469.249053:0:7617:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787779469.249130:0:7617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ece6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:7617:1874622524964608:0@lo:502: 00000100:00100000:1.0:1787779469.249177:0:7617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779469.249200:0:7617:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e8491156c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787779469.249454:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524964608 00000100:00100000:3.0:1787779469.249459:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524964608 00000100:00100000:3.0:1787779469.249479:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787779469.249486:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842efd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+12:7617:x1874622524964608:12345-0@lo:502: 00000100:00100000:3.0:1787779469.250749:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842efd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+12:7617:x1874622524964608:12345-0@lo:502: Request processed in 1257us (1565us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779469.250773:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787779469.250903:0:7617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ece6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:7617:1874622524964608:0@lo:502: 00000040:00080000:1.0:1787779469.251202:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1787779469.251258:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1787779469.251293:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1787779469.251355:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1787779469.251393:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1787779469.251428:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1787779469.251462:0:7617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ece6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:7617:1874622524964736:0@lo:502: 00000100:00100000:1.0:1787779469.251506:0:7617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779469.251683:0:7617:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e8491156c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787779469.251818:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524964736 00000100:00100000:3.0:1787779469.251824:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524964736 00000100:00100000:3.0:1787779469.251856:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787779469.251863:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842efe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+12:7617:x1874622524964736:12345-0@lo:502: 00000100:00100000:3.0:1787779469.252027:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842efe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+12:7617:x1874622524964736:12345-0@lo:502: Request processed in 164us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779469.252033:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787779469.252270:0:7617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ece6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:7617:1874622524964736:0@lo:502: 00000040:00080000:1.0:1787779469.252362:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1787779469.252375:0:7617:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1787779469.253016:0:7624:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787779469.253025:0:7624:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1787779469.253033:0:7624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787779469.253036:0:7624:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1787779469.253042:0:7624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787779469.253066:0:7624:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff98e873b04d28) 00000020:00000080:3.0:1787779469.253089:0:7624:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787779469.253095:0:7624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787779469.253236:0:7624:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98e87a56c800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1787779469.253244:0:7624:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787779469.253252:0:7624:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9e63ba8af6888e72 00010000:00010000:2.0:1787779469.261676:0:7624:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:2.0:1787779469.262636:0:7624:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1787779469.266231:0:7624:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1787779469.266543:0:7624:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1787779469.271939:0:7624:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1787779469.272415:0:7624:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1787779469.279928:0:7624:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1787779469.279954:0:7624:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787779469.279960:0:7624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787779469.279962:0:7624:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1787779469.279965:0:7624:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787779469.279969:0:7624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787779469.279970:0:7624:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787779469.279972:0:7624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787779469.279974:0:7624:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787779469.280025:0:7624:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787779469.280028:0:7624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787779469.280035:0:7624:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787779469.280038:0:7624:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1787779469.285021:0:7617:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1787779469.285063:0:7617:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1787779469.285088:0:7617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e8429d5a00/0x9e63ba8af6888e5d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888e64 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779469.285101:0:7617:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff98e8429d5a00/0x9e63ba8af6888e5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888e64 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787779469.285110:0:7617:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98e87a56c800 from 1 10000000:01000000:0.0:1787779469.285122:0:7617:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787779469.285162:0:7617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e848f69600/0x9e63ba8af6888e79 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779469.285170:0:7617:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff98e848f69600/0x9e63ba8af6888e79 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779469.285182:0:7617:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff98e848f69600/0x9e63ba8af6888e79 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779469.285207:0:7617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87aa54000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:7617:1874622524964864:0@lo:101: 00000100:00100000:0.0:1787779469.285282:0:7617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779469.285329:0:7617:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e87eb426c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787779469.285360:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524964864 00000100:00100000:0.0:1787779469.285367:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524964864 00000100:00100000:0.0:1787779469.285431:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787779469.285451:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842efd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+12:7617:x1874622524964864:12345-0@lo:101: 00010000:00010000:0.0:1787779469.285465:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787779469.285479:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e848f68000/0x9e63ba8af6888e80 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9e63ba8af6888e79 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779469.285504:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e848f68000/0x9e63ba8af6888e80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9e63ba8af6888e79 expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779469.285516:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e848f68000/0x9e63ba8af6888e80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af6888e79 expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779469.285749:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e848f68000, rc 0) 00000100:00100000:0.0:1787779469.285791:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842efd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+13:7617:x1874622524964864:12345-0@lo:101: Request processed in 343us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779469.285798:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787779469.285851:0:7617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87aa54000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:7617:1874622524964864:0@lo:101: 00010000:00010000:0.0:1787779469.285866:0:7617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff98e848f69600/0x9e63ba8af6888e79 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888e80 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779469.285876:0:7617:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff98e848f69600/0x9e63ba8af6888e79 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9e63ba8af6888e80 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779469.286043:0:7617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87aa54000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:7617:1874622524964992:0@lo:501: 00000100:00100000:0.0:1787779469.286068:0:7617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779469.286095:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524964992 00000100:00100000:0.0:1787779469.286099:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524964992 00000100:00100000:0.0:1787779469.286651:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787779469.286662:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842efc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+13:7617:x1874622524964992:12345-0@lo:501: 00000100:00100000:0.0:1787779469.286963:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842efc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+13:7617:x1874622524964992:12345-0@lo:501: Request processed in 305us (894us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779469.286971:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787779469.287015:0:7617:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e87eb426c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787779469.287033:0:7617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87aa54000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:7617:1874622524964992:0@lo:501: 00000100:00100000:0.0:1787779469.287069:0:7617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87aa54000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:7617:1874622524965120:0@lo:503: 00000100:00100000:0.0:1787779469.287108:0:7617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779469.289250:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524965120 00000100:00100000:0.0:1787779469.289267:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524965120 00000100:00100000:0.0:1787779469.289339:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787779469.289350:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842eff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+13:7617:x1874622524965120:12345-0@lo:503: 00000100:00100000:0.0:1787779469.291885:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842eff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+13:7617:x1874622524965120:12345-0@lo:503: Request processed in 2526us (4764us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779469.291901:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787779469.292000:0:7617:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e87eb426c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787779469.292023:0:7617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87aa54000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:7617:1874622524965120:0@lo:503: 00000040:00080000:0.0:1787779469.294027:0:7617:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787779469.297098:0:7617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87aa54000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:7617:1874622524965248:0@lo:502: 00000100:00100000:0.0:1787779469.297299:0:7617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779469.297618:0:7617:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e87eb426c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787779469.298966:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524965248 00000100:00100000:1.0:1787779469.298981:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524965248 00000100:00100000:1.0:1787779469.299037:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787779469.299047:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842efe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+13:7617:x1874622524965248:12345-0@lo:502: 00000100:00100000:1.0:1787779469.299345:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842efe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+13:7617:x1874622524965248:12345-0@lo:502: Request processed in 299us (2053us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779469.299359:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787779469.300260:0:7617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87aa54000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:7617:1874622524965248:0@lo:502: 00000040:00080000:0.0:1787779469.300828:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1787779469.300899:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1787779469.300939:0:7617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87aa54000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:7617:1874622524965376:0@lo:502: 00000100:00100000:0.0:1787779469.301016:0:7617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779469.301065:0:7617:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e87eb426c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787779469.301963:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524965376 00000100:00100000:1.0:1787779469.301972:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524965376 00000100:00100000:1.0:1787779469.302018:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787779469.302027:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842efec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+13:7617:x1874622524965376:12345-0@lo:502: 00000100:00100000:1.0:1787779469.303926:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842efec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+13:7617:x1874622524965376:12345-0@lo:502: Request processed in 1891us (2901us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779469.303940:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787779469.304651:0:7617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87aa54000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:7617:1874622524965376:0@lo:502: 00000040:00080000:0.0:1787779469.304848:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1787779469.304863:0:7617:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1787779469.308360:0:7628:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787779469.308375:0:7628:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787779469.308377:0:7628:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787779469.308384:0:7628:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98e87a56c800 00000020:00000080:0.0:1787779469.308387:0:7628:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787779469.308801:0:7628:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787779469.308806:0:7628:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787779469.308807:0:7628:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1787779469.308811:0:7628:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1787779469.310690:0:7617:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1787779469.310769:0:7617:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787779469.310791:0:7617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e848f69600/0x9e63ba8af6888e79 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888e80 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779469.310804:0:7617:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff98e848f69600/0x9e63ba8af6888e79 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888e80 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787779469.310856:0:7617:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787779469.310859:0:7617:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98e87a56c800 10000000:01000000:1.0:1787779469.310862:0:7617:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98e87a56c800 10000000:01000000:1.0:1787779469.310866:0:7617:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787779469.310873:0:7617:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98e87a56c800 from 1 10000000:01000000:1.0:1787779469.310875:0:7617:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787779469.310915:0:7617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e8429d5200/0x9e63ba8af6888e87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779469.310924:0:7617:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff98e8429d5200/0x9e63ba8af6888e87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779469.310943:0:7617:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff98e8429d5200/0x9e63ba8af6888e87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779469.310981:0:7617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ece6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:7617:1874622524965504:0@lo:101: 00000100:00100000:1.0:1787779469.311049:0:7617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779469.311086:0:7617:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e849115e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787779469.311175:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524965504 00000100:00100000:0.0:1787779469.311182:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524965504 00000100:00100000:0.0:1787779469.311219:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787779469.311228:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842efc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+13:7617:x1874622524965504:12345-0@lo:101: 00010000:00010000:0.0:1787779469.311240:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787779469.311254:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e848f69800/0x9e63ba8af6888e8e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9e63ba8af6888e87 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779469.311277:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e848f69800/0x9e63ba8af6888e8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9e63ba8af6888e87 expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779469.311287:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e848f69800/0x9e63ba8af6888e8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af6888e87 expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779469.311296:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e848f69800, rc 0) 00000100:00100000:0.0:1787779469.311334:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842efc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+14:7617:x1874622524965504:12345-0@lo:101: Request processed in 107us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779469.311340:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787779469.311746:0:7617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ece6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:7617:1874622524965504:0@lo:101: 00010000:00010000:1.0:1787779469.311762:0:7617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff98e8429d5200/0x9e63ba8af6888e87 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888e8e expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779469.311772:0:7617:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff98e8429d5200/0x9e63ba8af6888e87 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9e63ba8af6888e8e expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779469.311867:0:7617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ece6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:7617:1874622524965632:0@lo:501: 00000100:00100000:1.0:1787779469.311895:0:7617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779469.311921:0:7617:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e849115e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787779469.312023:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524965632 00000100:00100000:0.0:1787779469.312027:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524965632 00000100:00100000:0.0:1787779469.312050:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787779469.312056:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842efd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+14:7617:x1874622524965632:12345-0@lo:501: 00000100:00100000:0.0:1787779469.312287:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842efd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+14:7617:x1874622524965632:12345-0@lo:501: Request processed in 230us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779469.312295:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787779469.312355:0:7617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ece6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:7617:1874622524965632:0@lo:501: 00000100:00100000:2.0:1787779469.312384:0:7617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855b3d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:7617:1874622524965760:0@lo:503: 00000100:00100000:2.0:1787779469.312432:0:7617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779469.312466:0:7617:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e847472780 going to sleep for 11 seconds 00000100:00100000:0.0:1787779469.313068:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524965760 00000100:00100000:0.0:1787779469.313073:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524965760 00000100:00100000:0.0:1787779469.313120:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787779469.313129:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ef8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+14:7617:x1874622524965760:12345-0@lo:503: 00000100:00100000:0.0:1787779469.313315:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ef8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+14:7617:x1874622524965760:12345-0@lo:503: Request processed in 187us (882us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779469.313322:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787779469.313373:0:7617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855b3d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:7617:1874622524965760:0@lo:503: 00000040:00080000:0.0:1787779469.314987:0:7617:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787779469.315085:0:7617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87aa54000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:7617:1874622524965888:0@lo:502: 00000100:00100000:0.0:1787779469.315177:0:7617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779469.315231:0:7617:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e87eb423c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787779469.315319:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524965888 00000100:00100000:2.0:1787779469.315328:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524965888 00000100:00100000:2.0:1787779469.315368:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787779469.315377:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ef9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+14:7617:x1874622524965888:12345-0@lo:502: 00000100:00100000:2.0:1787779469.315638:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ef9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+14:7617:x1874622524965888:12345-0@lo:502: Request processed in 260us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779469.315646:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787779469.316177:0:7617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87aa54000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:7617:1874622524965888:0@lo:502: 00000040:00080000:0.0:1787779469.316465:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1787779469.316519:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1787779469.316828:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1787779469.316876:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1787779469.316910:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1787779469.316971:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1787779469.317005:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1787779469.317031:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1787779469.317082:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1787779469.317123:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1787779469.317154:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1787779469.317206:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1787779469.317253:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1787779469.317287:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1787779469.317335:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1787779469.317367:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1787779469.317400:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1787779469.317443:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1787779469.317477:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1787779469.317512:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1787779469.317575:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1787779469.317618:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1787779469.317642:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1787779469.317678:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1787779469.317744:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1787779469.317773:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1787779469.317813:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1787779469.317844:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:0.0:1787779469.317891:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1787779469.317946:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:0.0:1787779469.317981:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:0.0:1787779469.318009:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:0.0:1787779469.318034:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:0.0:1787779469.318073:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:0.0:1787779469.318104:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:0.0:1787779469.318145:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:0.0:1787779469.318179:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:0.0:1787779469.318229:0:7617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87aa54000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:7617:1874622524966016:0@lo:502: 00000100:00100000:0.0:1787779469.318303:0:7617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779469.318350:0:7617:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e8505a1300 going to sleep for 11 seconds 00000100:00100000:2.0:1787779469.318911:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524966016 00000100:00100000:2.0:1787779469.318919:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524966016 00000100:00100000:2.0:1787779469.318971:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787779469.318979:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ef8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+14:7617:x1874622524966016:12345-0@lo:502: 00000100:00100000:2.0:1787779469.319217:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ef8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+14:7617:x1874622524966016:12345-0@lo:502: Request processed in 238us (913us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779469.319225:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787779469.319408:0:7617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87aa54000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:7617:1874622524966016:0@lo:502: 00000040:00080000:1.0:1787779469.319497:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:1.0:1787779469.319511:0:7617:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1787779469.322005:0:7629:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1787779469.322024:0:7629:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff98e844cbcd28) 00000020:00000080:2.0:1787779469.322044:0:7629:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:2.0:1787779469.322141:0:7629:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98e87a56c800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787779469.322145:0:7629:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98e87a56c800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787779469.322148:0:7629:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98e87a56c800 3 00010000:00080000:2.0:1787779469.322180:0:7629:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98e87a9f6000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.109@tcp at head 00010000:00010000:0.0:1787779469.328686:0:7629:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:0.0:1787779469.328912:0:7629:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1787779469.328958:0:7629:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787779469.328972:0:7629:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x9e63ba8af6888e9c 00000100:00080000:0.0:1787779469.328984:0:7629:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787779469.328992:0:7629:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98e87a9f6000 using connection 192.168.201.109@tcp/0@lo 00000100:00100000:0.0:1787779469.329034:0:7629:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98e87aa56d00 x1874622524966144/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787779469.329079:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87aa56d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1874622524966144:0@lo:38: 00000100:00100000:0.0:1787779469.329155:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787779469.329219:0:7629:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787779469.329287:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87aa55e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874622524966272:0@lo:400: 00000100:00100000:0.0:1787779469.329312:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779469.329334:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787779469.329341:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87aa57c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874622524966400:0@lo:400: 00000100:00100000:0.0:1787779469.329361:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779469.329387:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87aa54b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874622524966528:0@lo:400: 00000100:00100000:0.0:1787779469.329412:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779469.329447:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524966144 00000100:00100000:0.0:1787779469.329455:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524966144 00000100:00100000:0.0:1787779469.329478:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524966272 00000100:00100000:0.0:1787779469.329481:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524966272 00000100:00100000:0.0:1787779469.329500:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524966400 00000100:00100000:0.0:1787779469.329502:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524966400 00000100:00100000:0.0:1787779469.329531:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787779469.329539:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87aa57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874622524966272:12345-0@lo:400: 00000100:00100000:0.0:1787779469.329625:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87aa57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874622524966272:12345-0@lo:400: Request processed in 85us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779469.329638:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787779469.329653:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787779469.329659:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87aa55a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874622524966400:12345-0@lo:400: 00000100:00100000:0.0:1787779469.329685:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87aa55a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874622524966400:12345-0@lo:400: Request processed in 27us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779469.329691:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787779469.329702:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787779469.329706:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87aa56580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3303:x1874622524966144:12345-0@lo:38: 00010000:00080000:0.0:1787779469.329752:0:5837:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 235 last 0 00000020:00000080:0.0:1787779469.329782:0:5837:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x9e63ba8af6888ea3 00000004:00100000:0.0:1787779469.329799:0:5837:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787779469.329826:0:5837:0:(import.c:65:import_set_state_nolock()) ffff98e851761000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787779469.329862:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87aa56580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874622524966144:12345-0@lo:38: Request processed in 155us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779469.329869:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787779469.329891:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524966528 00000100:00100000:0.0:1787779469.329895:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524966528 00000100:00100000:0.0:1787779469.329924:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787779469.329930:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87aa561c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874622524966528:12345-0@lo:400: 00000100:00100000:0.0:1787779469.329965:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87aa561c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874622524966528:12345-0@lo:400: Request processed in 35us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779469.329971:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1787779469.329985:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787779469.329989:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787779469.330024:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98e87aa54b40 x1874622524966528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779485 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779469.330049:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87aa54b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874622524966528:0@lo:400: 00010000:00080000:0.0:1787779469.330080:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98e87aa57c00 x1874622524966400/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779485 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779469.330089:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87aa57c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874622524966400:0@lo:400: 00010000:00080000:0.0:1787779469.330098:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98e87aa55e00 x1874622524966272/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779485 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779469.330106:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87aa55e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874622524966272:0@lo:400: 00010000:00080000:0.0:1787779469.330128:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98e87aa56d00 x1874622524966144/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787779479 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779469.330136:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787779469.330141:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1787779469.330149:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787779469.330153:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787779469.330155:0:3303:0:(import.c:65:import_set_state_nolock()) ffff98e87a9f6000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787779469.330161:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87aa56d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1874622524966144:0@lo:38: 00000040:00080000:2.0:1787779469.332140:0:7629:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:2.0:1787779469.332327:0:7617:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1787779469.332359:0:7617:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787779469.332377:0:7617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e8429d5200/0x9e63ba8af6888e87 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888e8e expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779469.332390:0:7617:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff98e8429d5200/0x9e63ba8af6888e87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888e8e expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787779469.332455:0:7617:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787779469.332457:0:7617:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787779469.332459:0:7617:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787779469.332460:0:7617:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787779469.332461:0:7617:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787779469.332463:0:7617:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787779469.332464:0:7617:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787779469.332466:0:7617:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787779469.332468:0:7617:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787779469.332469:0:7617:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787779469.332471:0:7617:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787779469.332475:0:7617:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1787779469.332478:0:7617:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787779469.332479:0:7617:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787779469.332480:0:7617:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787779469.332481:0:7617:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787779469.332482:0:7617:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787779469.332483:0:7617:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787779469.332485:0:7617:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787779469.332485:0:7617:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787779469.332487:0:7617:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787779469.332488:0:7617:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787779469.332489:0:7617:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787779469.332515:0:7617:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787779469.332544:0:7617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855b3d680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:7617:1874622524966656:0@lo:253: 00000100:00100000:2.0:1787779469.332622:0:7617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779469.332660:0:7617:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e8474726c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787779469.336663:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524966656 00000100:00100000:0.0:1787779469.336678:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524966656 00000100:00100000:0.0:1787779469.336765:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787779469.336776:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842efb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+14:7617:x1874622524966656:12345-0@lo:253: 20000000:01000000:0.0:1787779469.336812:0:5831:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1787779469.336827:0:5831:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1787779469.346628:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ece7840 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7630:1874622524966784:0@lo:901: 00000100:00100000:1.0:1787779469.346758:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779469.346802:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524966784 00000100:00100000:1.0:1787779469.346809:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524966784 00000100:00100000:1.0:1787779469.346868:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787779469.346878:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ece70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7630:x1874622524966784:12345-0@lo:901: 00000100:00100000:1.0:1787779469.347551:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ece70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7630:x1874622524966784:12345-0@lo:901: Request processed in 671us (790us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779469.347561:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787779469.347609:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e849115900 going to sleep for 11 seconds 00010000:00080000:1.0:1787779469.347634:0:7630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98e87ece7840 x1874622524966784/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787779485 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779469.347647:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ece7840 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7630:1874622524966784:0@lo:901: 00000100:00080000:0.0:1787779469.348044:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 20000000:01000000:0.0:1787779469.398770:0:5831:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787779469.398783:0:5831:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1787779469.400009:0:5851:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787779469.400021:0:5851:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787779469.400067:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98e882049000/0x9e63ba8af6888eaa lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779469.400088:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98e8429d5c00/0x9e63ba8af6888dfb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af6888df4 expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779469.400098:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98e882049000/0x9e63ba8af6888eaa lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779469.400160:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98e8429d5c00/0x9e63ba8af6888dfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9e63ba8af6888df4 expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779469.400179:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98e8429d5c00/0x9e63ba8af6888dfb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9e63ba8af6888df4 expref: 14 pid: 5831 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779469.400194:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855a63840 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5851:1874622524966912:0@lo:104: 00000100:00100000:3.0:1787779469.400279:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779469.400343:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e86d5a8300 going to sleep for 11 seconds 00000100:00100000:0.0:1787779469.400516:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524966912 00000100:00100000:0.0:1787779469.400534:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524966912 00000100:00100000:0.0:1787779469.400613:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787779469.400624:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e855a62940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c28aae66-2825-42c5-8f52-61f687e868c9+3:5851:x1874622524966912:12345-0@lo:104: 00010000:00010000:0.0:1787779469.400638:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.109@tcp lock: ffff98e840031a00/0x9e63ba8af6888df4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9e63ba8af6888dfb expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779469.400697:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787779469.400703:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e855a62940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c28aae66-2825-42c5-8f52-61f687e868c9+3:5851:x1874622524966912:12345-0@lo:104: Request processed in 83us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779469.400743:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1787779469.400768:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787779469.400774:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff98e840031a00/0x9e63ba8af6888df4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9e63ba8af6888dfb expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779469.400782:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e840031a00 already unused, calling callback (ffffffffc1cd5c20) 10000000:00010000:0.0:1787779469.400787:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff98e840031a00/0x9e63ba8af6888df4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9e63ba8af6888dfb expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779469.400796:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff98e840031a00/0x9e63ba8af6888df4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9e63ba8af6888dfb expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787779469.400804:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff98e840031a00/0x9e63ba8af6888df4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9e63ba8af6888dfb expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787779469.400810:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787779469.400841:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.109@tcp lock: ffff98e840031a00/0x9e63ba8af6888df4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af6888dfb expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779469.400848:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787779469.400881:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff98e840031a00/0x9e63ba8af6888df4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af6888dfb expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779469.400888:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff98e840031a00/0x9e63ba8af6888df4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af6888dfb expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779469.400909:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779469.400911:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779469.400913:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779469.400933:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87aa56d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c28aae66-2825-42c5-8f52-61f687e868c9:3305:1874622524967040:0@lo:103: 00000100:00100000:0.0:1787779469.400974:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779469.401336:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524967040 00000100:00100000:3.0:1787779469.401342:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524967040 00010000:00010000:3.0:1787779469.401361:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98e8429d5c00/0x9e63ba8af6888dfb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9e63ba8af6888df4 expref: 15 pid: 5831 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779469.401392:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787779469.401399:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e847d94c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c28aae66-2825-42c5-8f52-61f687e868c9+15:3305:x1874622524967040:12345-0@lo:103: 00010000:00010000:3.0:1787779469.401410:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787779469.401414:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98e8429d5c00/0x9e63ba8af6888dfb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9e63ba8af6888df4 expref: 15 pid: 5831 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779469.401431:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98e8429d5c00/0x9e63ba8af6888dfb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9e63ba8af6888df4 expref: 15 pid: 5831 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779469.401447:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98e882049000/0x9e63ba8af6888eaa lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779469.401455:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e882049000/0x9e63ba8af6888eaa lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787779469.401468:0:5821:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010557410s 00010000:00010000:3.0:1787779469.401472:0:5821:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98e882049000/0x9e63ba8af6888eaa lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779469.401479:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98e882049000/0x9e63ba8af6888eaa lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779469.401485:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98e882049000/0x9e63ba8af6888eaa lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779469.401492:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98e882049000/0x9e63ba8af6888eaa lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779469.401498:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e882049000 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:3.0:1787779469.401502:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98e882049000/0x9e63ba8af6888eaa lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779469.401509:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98e882049000/0x9e63ba8af6888eaa lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779469.402740:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98e882049000/0x9e63ba8af6888eaa lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779469.402781:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787779469.402860:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e847d94c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c28aae66-2825-42c5-8f52-61f687e868c9+15:3305:x1874622524967040:12345-0@lo:103: Request processed in 1459us (1883us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779469.402872:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1787779469.402967:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e8429d5c00/0x9e63ba8af6888dfb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9e63ba8af6888df4 expref: 14 pid: 5831 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779469.402982:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855a63840 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5851:1874622524966912:0@lo:104: 00010000:00010000:3.0:1787779469.403005:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98e882049000/0x9e63ba8af6888eaa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779469.403014:0:5851:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98e882049000/0x9e63ba8af6888eaa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779469.403021:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98e882049000/0x9e63ba8af6888eaa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779469.403028:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e882049000/0x9e63ba8af6888eaa lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779469.403694:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87aa56d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c28aae66-2825-42c5-8f52-61f687e868c9:3305:1874622524967040:0@lo:103: 00000100:00100000:3.0:1787779469.427309:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842efb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+13:7617:x1874622524966656:12345-0@lo:253: Request processed in 90521us (94674us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779469.427327:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787779469.427440:0:7617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855b3d680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c28aae66-2825-42c5-8f52-61f687e868c9:7617:1874622524966656:0@lo:253: 10000000:01000000:2.0:1787779469.427459:0:7617:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787779469.427463:0:7617:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787779469.427464:0:7617:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787779469.427466:0:7617:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787779469.427468:0:7617:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787779469.427469:0:7617:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787779469.427470:0:7617:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787779469.427487:0:7617:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787779469.427489:0:7617:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787779469.427490:0:7617:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787779469.427492:0:7617:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787779469.427494:0:7617:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787779469.427511:0:7617:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787779469.440606:0:7617:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1787779469.440847:0:7617:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787779469.441064:0:7617:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1787779469.441443:0:7617:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787779469.441742:0:7617:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1787779469.441990:0:7617:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1787779469.443632:0:7617:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1787779469.845400:0:7617:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1787779469.845408:0:7617:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1787779469.845447:0:7617:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787779469.845523:0:7617:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.109@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787779469.845538:0:7617:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1787779469.845567:0:7617:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1787779469.939726:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779470.963761:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787779471.989477:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779472.826593:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787779472.826620:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ece61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622524967168:0@lo:13: 00000100:00100000:1.0:1787779472.826690:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779472.826783:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524967168 00000100:00100000:1.0:1787779472.826792:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524967168 00000100:00100000:1.0:1787779472.826851:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787779472.826859:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ece7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622524967168:12345-0@lo:13: 00002000:00000024:1.0:1787779472.826894:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787779472.826936:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ece7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622524967168:12345-0@lo:13: Request processed in 78us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779472.826943:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1787779472.826963:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787779472.826992:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e87ece61c0 x1874622524967168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779488 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779472.827011:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ece61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622524967168:0@lo:13: 00010000:00010000:0.0:1787779473.017460:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787779474.039671:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779474.355110:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87aa55680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622524967680:0@lo:400: 00000100:00100000:0.0:1787779474.355195:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779474.355252:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787779474.355259:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87aa54b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c28aae66-2825-42c5-8f52-61f687e868c9:3306:1874622524967296:0@lo:400: 00000100:00100000:0.0:1787779474.355287:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779474.355307:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87aa552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1874622524967808:0@lo:400: 00000100:00100000:0.0:1787779474.355330:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779474.355353:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87aa543c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874622524967424:0@lo:400: 00000100:00100000:0.0:1787779474.355374:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779474.355389:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787779474.355411:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87aa54f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874622524967552:0@lo:400: 00000100:00100000:0.0:1787779474.355432:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779474.355463:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524967680 00000100:00100000:0.0:1787779474.355469:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524967680 00000100:00100000:0.0:1787779474.355534:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787779474.355544:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87aa56940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622524967680:12345-0@lo:400: 00000100:00100000:0.0:1787779474.355602:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87aa56940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622524967680:12345-0@lo:400: Request processed in 58us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779474.355609:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787779474.355630:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524967296 00000100:00100000:0.0:1787779474.355634:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524967296 00000100:00100000:2.0:1787779474.355672:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787779474.355681:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842efb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+13:3306:x1874622524967296:12345-0@lo:400: 00000100:00100000:2.0:1787779474.355733:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842efb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+13:3306:x1874622524967296:12345-0@lo:400: Request processed in 54us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779474.355892:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524967808 00000100:00100000:1.0:1787779474.355897:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524967808 00000100:00100000:1.0:1787779474.355925:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524967424 00000100:00100000:1.0:1787779474.355928:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524967424 00000100:00100000:1.0:1787779474.355938:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524967552 00000100:00100000:1.0:1787779474.355940:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524967552 00000100:00100000:1.0:1787779474.355963:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787779474.355970:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87aa55e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874622524967808:12345-0@lo:400: 00000100:00100000:1.0:1787779474.356004:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87aa55e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874622524967808:12345-0@lo:400: Request processed in 35us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779474.356010:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787779474.356022:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787779474.356028:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87aa56d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874622524967424:12345-0@lo:400: 00000100:00100000:1.0:1787779474.356059:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87aa56d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874622524967424:12345-0@lo:400: Request processed in 31us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779474.356065:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787779474.356077:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787779474.356083:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87aa570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874622524967552:12345-0@lo:400: 00000100:00100000:1.0:1787779474.356108:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87aa570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874622524967552:12345-0@lo:400: Request processed in 26us (676us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779474.356114:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1787779474.356150:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787779474.356155:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787779474.356190:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87aa54b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c28aae66-2825-42c5-8f52-61f687e868c9:3306:1874622524967296:0@lo:400: 00010000:00080000:1.0:1787779474.356207:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e87aa552c0 x1874622524967808/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779490 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779474.356221:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87aa552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1874622524967808:0@lo:400: 00010000:00080000:1.0:1787779474.356234:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e87aa55680 x1874622524967680/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779490 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779474.356243:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87aa55680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622524967680:0@lo:400: 00010000:00080000:1.0:1787779474.356291:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e87aa54f00 x1874622524967552/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779490 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779474.356309:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87aa54f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874622524967552:0@lo:400: 00010000:00080000:1.0:1787779474.356322:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e87aa543c0 x1874622524967424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779490 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779474.356330:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87aa543c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874622524967424:0@lo:400: 00000100:00100000:2.0:1787779474.367252:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00010000:1.0:1787779475.058965:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787779476.083086:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787779477.107838:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787779477.420344:0:7973:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg109-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1787779477.953082:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855b3cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874622524967936:0@lo:13: 00000100:00100000:1.0:1787779477.953184:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779477.953672:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524967936 00000100:00100000:2.0:1787779477.953684:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524967936 00000100:00100000:2.0:1787779477.953795:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787779477.953805:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ece61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874622524967936:12345-0@lo:13: 00002000:00000024:2.0:1787779477.953846:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787779477.953909:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ece61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874622524967936:12345-0@lo:13: Request processed in 105us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779477.953916:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1787779477.954144:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787779477.954177:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e855b3cf00 x1874622524967936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779493 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779477.954200:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855b3cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874622524967936:0@lo:13: 00010000:00010000:3.0:1787779478.132044:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787779478.971926:0:5833:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787779478.971936:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98e848ee5800 from 30 10000000:01000000:2.0:1787779478.971942:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787779478.971984:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e841649000/0x9e63ba8af6888eb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779478.971995:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff98e841649000/0x9e63ba8af6888eb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779478.972004:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff98e841649000/0x9e63ba8af6888eb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779478.972034:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855b3d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524968064:0@lo:101: 00000100:00100000:2.0:1787779478.972110:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779478.972209:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e846b0e180 going to sleep for 11 seconds 00000100:00100000:1.0:1787779478.974296:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524968064 00000100:00100000:1.0:1787779478.974310:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524968064 00000100:00100000:1.0:1787779478.974375:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787779478.974385:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842efa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+13:5833:x1874622524968064:12345-0@lo:101: 00010000:00010000:1.0:1787779478.974402:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779478.974434:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e8429d5800/0x9e63ba8af6888eb8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9e63ba8af6888eb1 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779478.974465:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e8429d5800/0x9e63ba8af6888eb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9e63ba8af6888eb1 expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779478.974478:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e8429d5800/0x9e63ba8af6888eb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af6888eb1 expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779478.974488:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e8429d5800, rc 0) 00000100:00100000:1.0:1787779478.974576:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842efa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+14:5833:x1874622524968064:12345-0@lo:101: Request processed in 192us (2465us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779478.974583:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787779478.974658:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855b3d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524968064:0@lo:101: 00010000:00010000:1.0:1787779478.974677:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff98e841649000/0x9e63ba8af6888eb1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888eb8 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779478.974687:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff98e841649000/0x9e63ba8af6888eb1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9e63ba8af6888eb8 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779478.974772:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ece6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524968192:0@lo:501: 00000100:00100000:1.0:1787779478.974805:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779478.974831:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e7436653c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787779478.974845:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524968192 00000100:00100000:1.0:1787779478.974848:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524968192 00000100:00100000:1.0:1787779478.974871:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787779478.974877:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ef9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+14:5833:x1874622524968192:12345-0@lo:501: 00000100:00100000:1.0:1787779478.975200:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ef9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+14:5833:x1874622524968192:12345-0@lo:501: Request processed in 322us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779478.975209:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787779478.975238:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ece6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524968192:0@lo:501: 00000100:00100000:1.0:1787779478.975269:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ece6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524968320:0@lo:503: 00000100:00100000:1.0:1787779478.975308:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779478.975320:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e7436653c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787779478.975332:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524968320 00000100:00100000:1.0:1787779478.975335:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524968320 00000100:00100000:1.0:1787779478.975355:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787779478.975368:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842efa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+14:5833:x1874622524968320:12345-0@lo:503: 00000100:00100000:1.0:1787779478.975647:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842efa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+14:5833:x1874622524968320:12345-0@lo:503: Request processed in 278us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779478.975654:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787779478.975690:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ece6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524968320:0@lo:503: 00000100:00100000:1.0:1787779478.975899:0:8046:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ece6940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c28aae66-2825-42c5-8f52-61f687e868c9:8046:1874622524968448:0@lo:502: 00000100:00100000:1.0:1787779478.975931:0:8046:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779478.975949:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524968448 00000100:00100000:1.0:1787779478.975953:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524968448 00000100:00100000:1.0:1787779478.975973:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787779478.975979:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ef9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+14:8046:x1874622524968448:12345-0@lo:502: 00000100:00100000:1.0:1787779478.976170:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ef9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+14:8046:x1874622524968448:12345-0@lo:502: Request processed in 190us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779478.976177:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787779478.976204:0:8046:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e743665840 going to sleep for 11 seconds 00000100:00100000:1.0:1787779478.976215:0:8046:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ece6940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c28aae66-2825-42c5-8f52-61f687e868c9:8046:1874622524968448:0@lo:502: 00000100:00100000:1.0:1787779478.976251:0:8046:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ece6940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c28aae66-2825-42c5-8f52-61f687e868c9:8046:1874622524968576:0@lo:502: 00000100:00100000:1.0:1787779478.976280:0:8046:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779478.976298:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524968576 00000100:00100000:1.0:1787779478.976302:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524968576 00000100:00100000:1.0:1787779478.976320:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787779478.976326:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ef8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+14:8046:x1874622524968576:12345-0@lo:502: 00000100:00100000:1.0:1787779478.976449:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ef8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+14:8046:x1874622524968576:12345-0@lo:502: Request processed in 122us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779478.976456:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787779478.976486:0:8046:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e743665840 going to sleep for 11 seconds 00000100:00100000:1.0:1787779478.976497:0:8046:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ece6940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c28aae66-2825-42c5-8f52-61f687e868c9:8046:1874622524968576:0@lo:502: 00000040:00080000:1.0:1787779478.976513:0:8046:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1787779478.976557:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1787779478.976572:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787779478.976580:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e841649000/0x9e63ba8af6888eb1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888eb8 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779478.976590:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff98e841649000/0x9e63ba8af6888eb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888eb8 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787779478.976599:0:5833:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1787779478.976602:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1787779478.976605:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787779478.976625:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e8429d4e00/0x9e63ba8af6888ebf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779478.976634:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff98e8429d4e00/0x9e63ba8af6888ebf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779478.976642:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff98e8429d4e00/0x9e63ba8af6888ebf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779478.976653:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ece6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524968704:0@lo:101: 00000100:00100000:1.0:1787779478.976676:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779478.976690:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e743665840 going to sleep for 11 seconds 00000100:00100000:1.0:1787779478.976701:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524968704 00000100:00100000:1.0:1787779478.976703:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524968704 00000100:00100000:1.0:1787779478.976743:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787779478.976750:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842efb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+14:5833:x1874622524968704:12345-0@lo:101: 00010000:00010000:1.0:1787779478.976765:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779478.976777:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e8429d5c00/0x9e63ba8af6888ec6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9e63ba8af6888ebf expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779478.976796:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e8429d5c00/0x9e63ba8af6888ec6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9e63ba8af6888ebf expref: 15 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779478.976806:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e8429d5c00/0x9e63ba8af6888ec6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af6888ebf expref: 15 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779478.976815:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e8429d5c00, rc 0) 00000100:00100000:1.0:1787779478.976842:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842efb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+15:5833:x1874622524968704:12345-0@lo:101: Request processed in 93us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779478.976849:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787779478.976876:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ece6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524968704:0@lo:101: 00010000:00010000:1.0:1787779478.976887:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff98e8429d4e00/0x9e63ba8af6888ebf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888ec6 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779478.976895:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff98e8429d4e00/0x9e63ba8af6888ebf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9e63ba8af6888ec6 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779478.976925:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ece6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524968832:0@lo:501: 00000100:00100000:1.0:1787779478.976948:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779478.976960:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e743665840 going to sleep for 11 seconds 00000100:00100000:1.0:1787779478.976970:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524968832 00000100:00100000:1.0:1787779478.976973:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524968832 00000100:00100000:1.0:1787779478.976992:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787779478.976997:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842efa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+15:5833:x1874622524968832:12345-0@lo:501: 00000100:00100000:1.0:1787779478.979970:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842efa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+15:5833:x1874622524968832:12345-0@lo:501: Request processed in 2962us (3011us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779478.979984:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787779478.989485:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ece6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524968832:0@lo:501: 00000100:00100000:3.0:1787779478.989627:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855a60780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524968960:0@lo:503: 00000100:00100000:3.0:1787779478.989705:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779478.989768:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e85191a540 going to sleep for 11 seconds 00000100:00100000:0.0:1787779478.989833:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524968960 00000100:00100000:0.0:1787779478.989839:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524968960 00000100:00100000:0.0:1787779478.989887:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787779478.989895:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842efac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+15:5833:x1874622524968960:12345-0@lo:503: 00000100:00100000:0.0:1787779478.990217:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842efac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+15:5833:x1874622524968960:12345-0@lo:503: Request processed in 321us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779478.990225:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787779478.990313:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855a60780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524968960:0@lo:503: 00000100:00100000:3.0:1787779478.990838:0:8047:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855a60780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c28aae66-2825-42c5-8f52-61f687e868c9:8047:1874622524969088:0@lo:502: 00000100:00100000:3.0:1787779478.990875:0:8047:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779478.990907:0:8047:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e85191a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787779478.991897:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524969088 00000100:00100000:0.0:1787779478.991904:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524969088 00000100:00100000:0.0:1787779478.991948:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787779478.991956:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ef8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+15:8047:x1874622524969088:12345-0@lo:502: 00000100:00100000:0.0:1787779478.992197:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ef8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+15:8047:x1874622524969088:12345-0@lo:502: Request processed in 241us (1320us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779478.992204:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787779478.993030:0:8047:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855a60780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c28aae66-2825-42c5-8f52-61f687e868c9:8047:1874622524969088:0@lo:502: 00000020:01000000:2.0:1787779478.993069:0:8047:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787779478.993080:0:8047:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787779478.993082:0:8047:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787779478.993088:0:8047:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787779478.993090:0:8047:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787779478.993121:0:8047:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855b3ed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c28aae66-2825-42c5-8f52-61f687e868c9:8047:1874622524969216:0@lo:502: 00000100:00100000:2.0:1787779478.993171:0:8047:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779478.993209:0:8047:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e846b0e600 going to sleep for 11 seconds 00000100:00100000:3.0:1787779478.993256:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524969216 00000100:00100000:3.0:1787779478.993262:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524969216 00000100:00100000:3.0:1787779478.993296:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787779478.993305:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ef9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+15:8047:x1874622524969216:12345-0@lo:502: 00000100:00100000:3.0:1787779478.993498:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ef9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+15:8047:x1874622524969216:12345-0@lo:502: Request processed in 195us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779478.993506:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787779478.993577:0:8047:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855b3ed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c28aae66-2825-42c5-8f52-61f687e868c9:8047:1874622524969216:0@lo:502: 00000020:01000000:2.0:1787779478.993597:0:8047:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787779478.993602:0:8047:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787779478.993603:0:8047:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787779478.993606:0:8047:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:3.0:1787779478.993788:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1787779478.993810:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787779478.993819:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e8429d4e00/0x9e63ba8af6888ebf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888ec6 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779478.993831:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff98e8429d4e00/0x9e63ba8af6888ebf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888ec6 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787779478.993841:0:5833:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787779478.993844:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98e846b05800 from 30 10000000:01000000:3.0:1787779478.993847:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787779478.993871:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e882049000/0x9e63ba8af6888ecd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779478.993879:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff98e882049000/0x9e63ba8af6888ecd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779478.993888:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff98e882049000/0x9e63ba8af6888ecd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779478.993899:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855a63840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524969344:0@lo:101: 00000100:00100000:3.0:1787779478.993927:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779478.993957:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e85191a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787779478.994015:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524969344 00000100:00100000:0.0:1787779478.994020:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524969344 00000100:00100000:0.0:1787779478.994049:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787779478.994055:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842efbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+15:5833:x1874622524969344:12345-0@lo:101: 00010000:00010000:0.0:1787779478.994063:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787779478.994074:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e848f68e00/0x9e63ba8af6888ed4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9e63ba8af6888ecd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779478.994104:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e848f68e00/0x9e63ba8af6888ed4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9e63ba8af6888ecd expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779478.994112:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e848f68e00/0x9e63ba8af6888ed4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af6888ecd expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779478.994121:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e848f68e00, rc 0) 00000100:00100000:0.0:1787779478.994148:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842efbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+16:5833:x1874622524969344:12345-0@lo:101: Request processed in 92us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779478.994154:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787779478.994211:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855a63840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524969344:0@lo:101: 00010000:00010000:3.0:1787779478.994223:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff98e882049000/0x9e63ba8af6888ecd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888ed4 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779478.994231:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff98e882049000/0x9e63ba8af6888ecd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9e63ba8af6888ed4 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779478.994270:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855a63840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524969472:0@lo:501: 00000100:00100000:3.0:1787779478.994299:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779478.994315:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e85191a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787779478.994347:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524969472 00000100:00100000:0.0:1787779478.994351:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524969472 00000100:00100000:0.0:1787779478.994405:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787779478.994422:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ebfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+16:5833:x1874622524969472:12345-0@lo:501: 00000100:00100000:0.0:1787779478.994638:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ebfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+16:5833:x1874622524969472:12345-0@lo:501: Request processed in 227us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779478.994644:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787779479.002262:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855a63840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524969472:0@lo:501: 00000100:00100000:3.0:1787779479.002325:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855a63840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524969600:0@lo:503: 00000100:00100000:3.0:1787779479.002406:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779479.002470:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e85191a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787779479.002539:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524969600 00000100:00100000:1.0:1787779479.002546:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524969600 00000100:00100000:1.0:1787779479.002589:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787779479.002597:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ebcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+16:5833:x1874622524969600:12345-0@lo:503: 00000100:00100000:1.0:1787779479.002851:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ebcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+16:5833:x1874622524969600:12345-0@lo:503: Request processed in 255us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779479.002859:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787779479.003064:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855a63840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524969600:0@lo:503: 00000100:00100000:1.0:1787779479.004368:0:8048:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ece43c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c28aae66-2825-42c5-8f52-61f687e868c9:8048:1874622524969728:0@lo:502: 00000100:00100000:1.0:1787779479.004451:0:8048:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779479.004492:0:8048:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e743665300 going to sleep for 11 seconds 00000100:00100000:0.0:1787779479.006952:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524969728 00000100:00100000:0.0:1787779479.006965:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524969728 00000100:00100000:0.0:1787779479.007017:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787779479.007025:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ebdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+16:8048:x1874622524969728:12345-0@lo:502: 00000100:00100000:0.0:1787779479.007289:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ebdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+16:8048:x1874622524969728:12345-0@lo:502: Request processed in 263us (2836us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779479.007296:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787779479.008529:0:8048:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ece43c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c28aae66-2825-42c5-8f52-61f687e868c9:8048:1874622524969728:0@lo:502: 00000100:00100000:1.0:1787779479.008606:0:8048:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ece43c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c28aae66-2825-42c5-8f52-61f687e868c9:8048:1874622524969856:0@lo:502: 00000100:00100000:1.0:1787779479.008664:0:8048:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779479.008728:0:8048:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e743665300 going to sleep for 11 seconds 00000100:00100000:3.0:1787779479.008945:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524969856 00000100:00100000:3.0:1787779479.008951:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524969856 00000100:00100000:3.0:1787779479.008998:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787779479.009007:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ebc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+16:8048:x1874622524969856:12345-0@lo:502: 00000100:00100000:3.0:1787779479.009228:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ebc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+16:8048:x1874622524969856:12345-0@lo:502: Request processed in 221us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779479.009236:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787779479.009269:0:8048:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ece43c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c28aae66-2825-42c5-8f52-61f687e868c9:8048:1874622524969856:0@lo:502: 00000040:00080000:1.0:1787779479.009289:0:8048:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1787779479.011946:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1787779479.011994:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787779479.012007:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e882049000/0x9e63ba8af6888ecd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888ed4 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779479.012020:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff98e882049000/0x9e63ba8af6888ecd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888ed4 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787779479.012032:0:5833:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787779479.012036:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98e846b05800 from 5 10000000:01000000:3.0:1787779479.012039:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787779479.012086:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e882048800/0x9e63ba8af6888edb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779479.012112:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff98e882048800/0x9e63ba8af6888edb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779479.012124:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff98e882048800/0x9e63ba8af6888edb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779479.012148:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855a63840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524969984:0@lo:101: 00000100:00100000:3.0:1787779479.012215:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779479.012262:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e85191a000 going to sleep for 11 seconds 00000100:00100000:1.0:1787779479.012278:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524969984 00000100:00100000:1.0:1787779479.012286:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524969984 00000100:00100000:1.0:1787779479.012344:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787779479.012354:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ebf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+16:5833:x1874622524969984:12345-0@lo:101: 00010000:00010000:1.0:1787779479.012368:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779479.012383:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e8429d4600/0x9e63ba8af6888ee2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9e63ba8af6888edb expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779479.012426:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e8429d4600/0x9e63ba8af6888ee2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9e63ba8af6888edb expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779479.012438:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e8429d4600/0x9e63ba8af6888ee2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af6888edb expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779479.012448:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e8429d4600, rc 0) 00000100:00100000:1.0:1787779479.012495:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ebf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+17:5833:x1874622524969984:12345-0@lo:101: Request processed in 142us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779479.012502:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787779479.012540:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855a63840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524969984:0@lo:101: 00010000:00010000:3.0:1787779479.012555:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff98e882048800/0x9e63ba8af6888edb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888ee2 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779479.012565:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff98e882048800/0x9e63ba8af6888edb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9e63ba8af6888ee2 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779479.012615:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855a63840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524970112:0@lo:256: 00000100:00100000:3.0:1787779479.012657:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779479.012676:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e85191a000 going to sleep for 11 seconds 00000100:00100000:0.0:1787779479.012738:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524970112 00000100:00100000:0.0:1787779479.012742:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524970112 00000100:00100000:0.0:1787779479.012770:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787779479.012783:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ebf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+17:5833:x1874622524970112:12345-0@lo:256: 20000000:01000000:0.0:1787779479.012796:0:5830:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787779479.012811:0:5830:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787779479.012814:0:5830:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1787779479.012900:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ebf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+17:5833:x1874622524970112:12345-0@lo:256: Request processed in 118us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779479.012907:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787779479.013231:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855a63840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524970112:0@lo:256: 10000000:01000000:1.0:1787779479.013271:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787779479.013276:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e882048800/0x9e63ba8af6888edb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888ee2 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779479.013284:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff98e882048800/0x9e63ba8af6888edb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888ee2 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787779479.013291:0:5833:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1787779479.013293:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1787779479.013295:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787779479.013324:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e8429d4400/0x9e63ba8af6888ee9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779479.013332:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff98e8429d4400/0x9e63ba8af6888ee9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779479.013340:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff98e8429d4400/0x9e63ba8af6888ee9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779479.013358:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ece43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524970240:0@lo:101: 00000100:00100000:1.0:1787779479.013383:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779479.013405:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e7436650c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787779479.013440:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524970240 00000100:00100000:3.0:1787779479.013445:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524970240 00000100:00100000:3.0:1787779479.013474:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787779479.013481:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ebe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+17:5833:x1874622524970240:12345-0@lo:101: 00010000:00010000:3.0:1787779479.013489:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779479.013499:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e882048a00/0x9e63ba8af6888ef0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9e63ba8af6888ee9 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779479.013523:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e882048a00/0x9e63ba8af6888ef0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9e63ba8af6888ee9 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779479.013532:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e882048a00/0x9e63ba8af6888ef0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af6888ee9 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779479.013540:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e882048a00, rc 0) 00000100:00100000:3.0:1787779479.013576:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ebe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+18:5833:x1874622524970240:12345-0@lo:101: Request processed in 96us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779479.013582:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787779479.013674:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ece43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524970240:0@lo:101: 00010000:00010000:1.0:1787779479.013684:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff98e8429d4400/0x9e63ba8af6888ee9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888ef0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779479.013692:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff98e8429d4400/0x9e63ba8af6888ee9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9e63ba8af6888ef0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779479.013750:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ece43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524970368:0@lo:501: 00000100:00100000:1.0:1787779479.013775:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779479.013797:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e7436650c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787779479.013817:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524970368 00000100:00100000:3.0:1787779479.013821:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524970368 00000100:00100000:3.0:1787779479.013849:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787779479.013855:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ebd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+18:5833:x1874622524970368:12345-0@lo:501: 00000100:00100000:3.0:1787779479.014086:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ebd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+18:5833:x1874622524970368:12345-0@lo:501: Request processed in 231us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779479.014094:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787779479.014265:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ece43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524970368:0@lo:501: 00000100:00100000:1.0:1787779479.014292:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ece43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524970496:0@lo:503: 00000100:00100000:1.0:1787779479.014337:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779479.014365:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e7436650c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787779479.014475:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524970496 00000100:00100000:0.0:1787779479.014479:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524970496 00000100:00100000:0.0:1787779479.014507:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787779479.014514:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ebe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+18:5833:x1874622524970496:12345-0@lo:503: 00000100:00100000:0.0:1787779479.014873:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ebe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+18:5833:x1874622524970496:12345-0@lo:503: Request processed in 359us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779479.014881:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787779479.016532:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ece43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524970496:0@lo:503: 00000100:00100000:1.0:1787779479.017682:0:8049:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ece43c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c28aae66-2825-42c5-8f52-61f687e868c9:8049:1874622524970624:0@lo:502: 00000100:00100000:1.0:1787779479.017789:0:8049:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779479.017831:0:8049:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e743665480 going to sleep for 11 seconds 00000100:00100000:2.0:1787779479.017888:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524970624 00000100:00100000:2.0:1787779479.017895:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524970624 00000100:00100000:2.0:1787779479.017939:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787779479.017949:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ebd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+18:8049:x1874622524970624:12345-0@lo:502: 00000100:00100000:2.0:1787779479.018295:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ebd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+18:8049:x1874622524970624:12345-0@lo:502: Request processed in 347us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779479.018302:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787779479.018539:0:8049:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ece43c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c28aae66-2825-42c5-8f52-61f687e868c9:8049:1874622524970624:0@lo:502: 00000020:01000000:1.0:1787779479.018566:0:8049:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787779479.018575:0:8049:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1787779479.018588:0:8049:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787779479.018590:0:8049:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1787779479.018595:0:8049:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787779479.018598:0:8049:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.109@tcp to nid 0x20000c0a8c96d (192.168.201.109@tcp) 00000020:01000000:1.0:1787779479.018619:0:8049:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787779479.018621:0:8049:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787779479.018636:0:8049:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff98e842f1cd28) 00000020:00000080:1.0:1787779479.018659:0:8049:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1787779479.018664:0:8049:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787779479.018766:0:8049:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1787779479.018772:0:8049:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:1.0:1787779479.018793:0:8049:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9e63ba8af6888efe 00010000:00080000:1.0:1787779479.018825:0:8049:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98e851780000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.109@tcp at head 00010000:00010000:1.0:1787779479.019051:0:8049:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:1.0:1787779479.019367:0:8049:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1787779479.019379:0:8049:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787779479.019956:0:8049:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787779479.020159:0:8049:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787779479.020212:0:8049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1787779479.020280:0:8049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1787779479.031049:0:8050:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787779479.031058:0:8050:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1787779479.031979:0:8049:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787779479.031991:0:8049:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787779479.032022:0:8049:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787779479.032044:0:8049:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9e63ba8af6888f05 00000100:00080000:3.0:1787779479.032057:0:8049:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787779479.032063:0:8049:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98e851780000 using connection 192.168.201.109@tcp/0@lo 00000100:00100000:3.0:1787779479.032098:0:8049:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98e855a63840 x1874622524970752/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787779479.032118:0:8049:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1787779479.032173:0:8049:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787779479.032188:0:8049:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787779479.032191:0:8049:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1787779479.032194:0:8049:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787779479.032198:0:8049:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787779479.032200:0:8049:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787779479.032203:0:8049:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787779479.032205:0:8049:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787779479.032235:0:8049:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855a60780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c28aae66-2825-42c5-8f52-61f687e868c9:8049:1874622524970880:0@lo:502: 00000100:00100000:3.0:1787779479.032316:0:8049:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779479.032352:0:8049:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e85191a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787779479.032470:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524970880 00000100:00100000:3.0:1787779479.032479:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524970880 00000100:00100000:3.0:1787779479.032523:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787779479.032533:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ebc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+18:8049:x1874622524970880:12345-0@lo:502: 00000100:00100000:2.0:1787779479.032761:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87a708b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874622524971136:0@lo:400: 00000100:00100000:3.0:1787779479.032776:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ebc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+18:8049:x1874622524970880:12345-0@lo:502: Request processed in 244us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779479.032784:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787779479.032794:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779479.032820:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87a70b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622524971264:0@lo:400: 00000100:00100000:2.0:1787779479.032833:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87a709a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874622524971392:0@lo:400: 00000100:00100000:3.0:1787779479.032848:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779479.032860:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779479.032877:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787779479.032880:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524971264 00000100:00100000:2.0:1787779479.032882:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e853585e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874622524971008:0@lo:400: 00000100:00100000:3.0:1787779479.032883:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524971264 00000100:00100000:2.0:1787779479.032901:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779479.032916:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787779479.032922:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a70a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622524971264:12345-0@lo:400: 00000100:00100000:2.0:1787779479.032926:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524971136 00000100:00100000:2.0:1787779479.032928:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524971136 00000100:00100000:2.0:1787779479.032947:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524971392 00000100:00100000:2.0:1787779479.032950:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524971392 00000100:00100000:3.0:1787779479.032954:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a70a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622524971264:12345-0@lo:400: Request processed in 33us (106us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779479.032960:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787779479.032961:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524971008 00000100:00100000:2.0:1787779479.032963:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524971008 00000100:00100000:2.0:1787779479.032973:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1787779479.032974:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787779479.032978:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787779479.032979:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e855b3ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874622524971136:12345-0@lo:400: 00010000:00080000:3.0:1787779479.033002:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e87a70b480 x1874622524971264/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779495 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779479.033011:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e855b3ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874622524971136:12345-0@lo:400: Request processed in 33us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779479.033017:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787779479.033021:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87a70b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622524971264:0@lo:400: 00000100:00100000:2.0:1787779479.033029:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787779479.033034:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e855b3e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874622524971392:12345-0@lo:400: 00000100:00100000:3.0:1787779479.033045:0:8049:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855a60780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c28aae66-2825-42c5-8f52-61f687e868c9:8049:1874622524970880:0@lo:502: 00000100:00100000:2.0:1787779479.033061:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e855b3e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874622524971392:12345-0@lo:400: Request processed in 28us (200us total) trans 0 rc 0/0 00000020:01000000:3.0:1787779479.033065:0:8049:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00100000:2.0:1787779479.033066:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000020:00000080:3.0:1787779479.033070:0:8049:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787779479.033072:0:8049:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787779479.033076:0:8049:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00100000:2.0:1787779479.033076:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787779479.033081:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e855b3c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874622524971008:12345-0@lo:400: 00000100:00100000:2.0:1787779479.033102:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e855b3c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874622524971008:12345-0@lo:400: Request processed in 21us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779479.033107:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1787779479.033134:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e87a708b40 x1874622524971136/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779495 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779479.033153:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87a708b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874622524971136:0@lo:400: 00000020:01000000:3.0:1787779479.033172:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 00010000:00080000:2.0:1787779479.033173:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e853585e00 x1874622524971008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779495 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779479.033180:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e853585e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874622524971008:0@lo:400: 10000000:01000000:3.0:1787779479.033188:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787779479.033197:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e8429d4400/0x9e63ba8af6888ee9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888ef0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:2.0:1787779479.033203:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e87a709a40 x1874622524971392/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779495 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1787779479.033207:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff98e8429d4400/0x9e63ba8af6888ee9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888ef0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779479.033211:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87a709a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874622524971392:0@lo:400: 10000000:01000000:3.0:1787779479.033218:0:5833:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1787779479.033221:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff98e842f18000 from 1 10000000:01000000:3.0:1787779479.033223:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787779479.033247:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e882049c00/0x9e63ba8af6888f0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779479.033255:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff98e882049c00/0x9e63ba8af6888f0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779479.033263:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff98e882049c00/0x9e63ba8af6888f0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779479.033275:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87a70b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524971520:0@lo:101: 00000100:00100000:3.0:1787779479.033301:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779479.033344:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e85191a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787779479.033451:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855a63840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874622524970752:0@lo:8: 00000100:00100000:0.0:1787779479.033486:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779479.033536:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524970752 00000100:00100000:0.0:1787779479.033540:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524970752 00000100:00100000:0.0:1787779479.033558:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787779479.033563:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87aa54780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3303:x1874622524970752:12345-0@lo:8: 00010000:00080000:0.0:1787779479.033582:0:6681:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 244 last 0 00000020:00000080:0.0:1787779479.033607:0:6681:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9e63ba8af6888f13 00002000:00100000:0.0:1787779479.033621:0:6681:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff98e851765800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113939 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1787779479.033624:0:6681:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:0.0:1787779479.033634:0:6681:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1787779479.033767:0:6681:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787779479.033938:0:6681:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787779479.033962:0:6681:0:(import.c:65:import_set_state_nolock()) ffff98e851766800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787779479.034006:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87aa54780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1874622524970752:12345-0@lo:8: Request processed in 441us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779479.034014:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1787779479.034046:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e855a63840 x1874622524970752/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787779489 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779479.034054:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787779479.034061:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1787779479.034068:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787779479.034074:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1787779479.034077:0:3303:0:(import.c:65:import_set_state_nolock()) ffff98e851780000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787779479.034088:0:3303:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787779479.034092:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855a63840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874622524970752:0@lo:8: 00000004:00080000:0.0:1787779479.034113:0:8050:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787779479.034211:0:8050:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 244775499002ns, next at 0ns, rc = 0 00000100:00100000:2.0:1787779479.034794:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524971520 00000100:00100000:2.0:1787779479.034800:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524971520 00000100:00100000:2.0:1787779479.034830:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787779479.034838:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ebf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+18:5833:x1874622524971520:12345-0@lo:101: 00010000:00010000:2.0:1787779479.034850:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779479.034866:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e841648e00/0x9e63ba8af6888f1a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x9e63ba8af6888f0c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779479.034888:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e841648e00/0x9e63ba8af6888f1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9e63ba8af6888f0c expref: 19 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779479.034899:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e841648e00/0x9e63ba8af6888f1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af6888f0c expref: 19 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779479.034907:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e841648e00, rc 0) 00000100:00100000:2.0:1787779479.034946:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ebf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+19:5833:x1874622524971520:12345-0@lo:101: Request processed in 108us (1644us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779479.034951:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787779479.035823:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87a70b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524971520:0@lo:101: 00010000:00010000:3.0:1787779479.035850:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff98e882049c00/0x9e63ba8af6888f0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888f1a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779479.035864:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff98e882049c00/0x9e63ba8af6888f0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9e63ba8af6888f1a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779479.035934:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87a70b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524971648:0@lo:501: 00000100:00100000:3.0:1787779479.035983:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779479.036022:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524971648 00000100:00100000:3.0:1787779479.036028:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524971648 00000100:00100000:3.0:1787779479.036063:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787779479.036072:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ebe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+19:5833:x1874622524971648:12345-0@lo:501: 00000100:00100000:3.0:1787779479.036275:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ebe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+19:5833:x1874622524971648:12345-0@lo:501: Request processed in 203us (292us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787779479.036283:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787779479.036325:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e85191a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787779479.036336:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87a70b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524971648:0@lo:501: 10000000:01000000:3.0:1787779479.036361:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787779479.036368:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e882049c00/0x9e63ba8af6888f0c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888f1a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779479.036377:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff98e882049c00/0x9e63ba8af6888f0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888f1a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787779479.097292:0:5857:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:3.0:1787779479.157883:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787779479.199567:0:8052:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1787779479.199616:0:8052:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87a7083c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8052:1874622524971904:0@lo:7: 00000100:00100000:3.0:1787779479.199696:0:8052:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779479.199777:0:8052:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e846ae8900 going to sleep for 11 seconds 00000100:00100000:3.0:1787779479.199795:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787779479.199809:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87a70b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874622524971776:0@lo:13: 00000100:00100000:3.0:1787779479.199837:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779479.199868:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524971904 00000100:00100000:3.0:1787779479.199877:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524971904 00000100:00100000:3.0:1787779479.199933:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787779479.199943:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a708f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8052:x1874622524971904:12345-0@lo:7: 00000100:00080000:0.0:1787779479.205363:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787779479.205449:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524971776 00000100:00100000:2.0:1787779479.205460:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524971776 00000100:00100000:2.0:1787779479.205527:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787779479.205540:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a709680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1874622524971776:12345-0@lo:13: 00002000:00000024:2.0:1787779479.205583:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1787779479.205681:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a709680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1874622524971776:12345-0@lo:13: Request processed in 145us (5842us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779479.205688:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1787779479.205969:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e87a70b480 x1874622524971776/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779495 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779479.205992:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87a70b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874622524971776:0@lo:13: 00002000:00080000:2.0:1787779479.215814:0:6682:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1787779479.215823:0:6682:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1787779479.215969:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a708f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8052:x1874622524971904:12345-0@lo:7: Request processed in 16022us (16267us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779479.215983:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1787779479.216069:0:8052:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e87a7083c0 x1874622524971904/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787779495 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779479.216261:0:8052:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87a7083c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8052:1874622524971904:0@lo:7: 00000004:00080000:3.0:1787779479.216281:0:8052:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1787779479.216332:0:8052:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87a7083c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8052:1874622524972032:0@lo:5: 00000100:00100000:3.0:1787779479.216466:0:8052:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779479.216561:0:8052:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e846ae8900 going to sleep for 11 seconds 00000100:00100000:0.0:1787779479.216601:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524972032 00000100:00100000:0.0:1787779479.216609:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524972032 00000100:00100000:0.0:1787779479.216690:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787779479.216701:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a70b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8052:x1874622524972032:12345-0@lo:5: 00002000:00080000:2.0:1787779479.217028:0:6680:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1787779479.217034:0:6680:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1787779479.217905:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a70b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:8052:x1874622524972032:12345-0@lo:5: Request processed in 1203us (1435us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1787779479.217914:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1787779479.217990:0:8052:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e87a7083c0 x1874622524972032/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787779495 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779479.218007:0:8052:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87a7083c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8052:1874622524972032:0@lo:5: 00000004:00080000:3.0:1787779479.218019:0:8052:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1787779479.218057:0:8052:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87a7092c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8052:1874622524972160:0@lo:700: 00000100:00100000:3.0:1787779479.218208:0:8052:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779479.218271:0:8052:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e846ae8900 going to sleep for 11 seconds 00000100:00100000:0.0:1787779479.218304:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524972160 00000100:00100000:0.0:1787779479.218309:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524972160 00000100:00100000:0.0:1787779479.218465:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787779479.218474:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a70a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8052:x1874622524972160:12345-0@lo:700: 00000100:00100000:0.0:1787779479.218508:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87aa57840 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6688:1874622524972288:0@lo:700: 00000100:00100000:0.0:1787779479.218550:0:6688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779479.218580:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e848f40e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787779479.218632:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524972288 00000100:00100000:3.0:1787779479.218636:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524972288 00000100:00100000:3.0:1787779479.218676:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787779479.218684:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87aa57c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6688:x1874622524972288:12345-0@lo:700: 40000000:02000000:0.0:1787779479.260042:0:5842:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:1.0:1787779479.271492:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87aa57c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6688:x1874622524972288:12345-0@lo:700: Request processed in 52799us (52930us total) trans 0 rc 0/0 00010000:00080000:0.0:1787779479.271523:0:6688:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e87aa57840 x1874622524972288/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787779495 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779479.271540:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787779479.271544:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87aa57840 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6688:1874622524972288:0@lo:700: 40000000:02000000:0.0:1787779479.271560:0:6688:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00100000:2.0:1787779479.370311:0:7634:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1787779479.370333:0:7634:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:1.0:1787779479.370513:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a70a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8052:x1874622524972160:12345-0@lo:700: Request processed in 152037us (152301us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779479.370527:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787779479.370616:0:8052:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e87a7092c0 x1874622524972160/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787779495 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779479.370629:0:8052:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1787779479.370657:0:8052:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87a7092c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8052:1874622524972160:0@lo:700: 00000004:02000040:3.0:1787779479.407773:0:8052:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:3.0:1787779479.413206:0:8052:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87a7092c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8052:1874622524972416:0@lo:5: 00000100:00100000:3.0:1787779479.413272:0:8052:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779479.413322:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524972416 00000100:00100000:3.0:1787779479.413328:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524972416 00000100:00100000:3.0:1787779479.413387:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787779479.413509:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a7083c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8052:x1874622524972416:12345-0@lo:5: 00000100:00100000:1.0:1787779479.419769:0:8052:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e846ae8f00 going to sleep for 11 seconds 00002000:00080000:3.0:1787779479.430190:0:6682:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1787779479.430216:0:6682:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1787779479.438866:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a7083c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8052:x1874622524972416:12345-0@lo:5: Request processed in 25462us (25584us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787779479.438883:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1787779479.439120:0:8052:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e87a7092c0 x1874622524972416/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787779495 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779479.439139:0:8052:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87a7092c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8052:1874622524972416:0@lo:5: 00000004:00080000:0.0:1787779479.439155:0:8052:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:3.0:1787779480.178869:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787779481.203033:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779482.232048:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787779482.816462:0:7634:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:0.0:1787779483.061753:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855b3cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622524972544:0@lo:13: 00000100:00100000:0.0:1787779483.061830:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779483.062011:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524972544 00000100:00100000:2.0:1787779483.062021:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524972544 00000100:00100000:2.0:1787779483.062073:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787779483.062083:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87aa543c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622524972544:12345-0@lo:13: 00002000:00000024:2.0:1787779483.062119:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787779483.062177:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87aa543c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622524972544:12345-0@lo:13: Request processed in 95us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779483.062184:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1787779483.062224:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787779483.062487:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e855b3cf00 x1874622524972544/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779499 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779483.062509:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855b3cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622524972544:0@lo:13: 00010000:00010000:3.0:1787779483.251963:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779483.479080:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779483.479383:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505025664 00000100:00100000:1.0:1787779483.479394:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505025664 00000100:00100000:1.0:1787779483.479438:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 112 00000100:00100000:1.0:1787779483.479446:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ebec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2356:x1874622505025664:12345-192.168.201.9@tcp:250: 00010000:00080000:1.0:1787779483.479474:0:5828:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e@192.168.201.9@tcp t0 exp 0000000000000000 cur 249 last 0 00000020:00000080:1.0:1787779483.479500:0:5828:0:(genops.c:1385:class_connect()) connect: client ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e, cookie 0x9e63ba8af6888f21 00000100:00080000:1.0:1787779483.479628:0:5828:0:(import.c:65:import_set_state_nolock()) ffff98e851787000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787779483.479695:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ebec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+5:2356:x1874622505025664:12345-192.168.201.9@tcp:250: Request processed in 247us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779483.479703:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 112 00000100:00100000:3.0:1787779483.481925:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779483.482140:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505025792 00000100:00100000:1.0:1787779483.482151:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505025792 00000100:00100000:1.0:1787779483.482198:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 113 00000100:00100000:1.0:1787779483.482208:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ebc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+5:5587:x1874622505025792:12345-192.168.201.9@tcp:101: 00010000:00010000:1.0:1787779483.482227:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779483.482244:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e8429d4000/0x9e63ba8af6888f28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedab06 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779483.482273:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e8429d4000/0x9e63ba8af6888f28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedab06 expref: 6 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779483.482285:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e8429d4000/0x9e63ba8af6888f28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedab06 expref: 6 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779483.482306:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e8429d4000, rc 0) 00000100:00100000:1.0:1787779483.482363:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ebc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+6:5587:x1874622505025792:12345-192.168.201.9@tcp:101: Request processed in 155us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779483.482379:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 113 00000100:00100000:1.0:1787779483.485509:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779483.487113:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505025920 00000100:00100000:0.0:1787779483.487128:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505025920 00000100:00100000:0.0:1787779483.487195:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 114 00000100:00100000:0.0:1787779483.487205:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ebd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+6:5587:x1874622505025920:12345-192.168.201.9@tcp:501: 00000100:00100000:0.0:1787779483.487571:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ebd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+6:5587:x1874622505025920:12345-192.168.201.9@tcp:501: Request processed in 365us (2070us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787779483.487580:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 114 00000100:00100000:0.0:1787779483.495345:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779483.495459:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505026048 00000100:00100000:1.0:1787779483.495469:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505026048 00000100:00100000:1.0:1787779483.495522:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 115 00000100:00100000:1.0:1787779483.495532:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+6:5587:x1874622505026048:12345-192.168.201.9@tcp:101: 00010000:00010000:1.0:1787779483.495553:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779483.495574:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e8429d4a00/0x9e63ba8af6888f2f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedab0d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779483.495604:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e8429d4a00/0x9e63ba8af6888f2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedab0d expref: 7 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779483.495614:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e8429d4a00/0x9e63ba8af6888f2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedab0d expref: 7 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779483.495624:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e8429d4a00, rc 0) 00000100:00100000:1.0:1787779483.495687:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+7:5587:x1874622505026048:12345-192.168.201.9@tcp:101: Request processed in 157us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779483.495695:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 115 00000100:00100000:0.0:1787779483.497670:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779483.497772:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505026176 00000100:00100000:3.0:1787779483.497780:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505026176 00000100:00100000:3.0:1787779483.497829:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 116 00000100:00100000:3.0:1787779483.497839:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+7:5587:x1874622505026176:12345-192.168.201.9@tcp:501: 00000100:00100000:3.0:1787779483.498124:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+8:5587:x1874622505026176:12345-192.168.201.9@tcp:501: Request processed in 285us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779483.498132:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 116 00000100:00100000:0.0:1787779483.500822:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779483.500884:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505026304 00000100:00100000:3.0:1787779483.500894:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505026304 00000100:00100000:3.0:1787779483.500946:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 117 00000100:00100000:3.0:1787779483.500965:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+8:5587:x1874622505026304:12345-192.168.201.9@tcp:503: 00000100:00100000:3.0:1787779483.501461:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+8:5587:x1874622505026304:12345-192.168.201.9@tcp:503: Request processed in 496us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779483.501470:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 117 00000100:00100000:2.0:1787779483.507471:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779483.507557:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505026432 00000100:00100000:3.0:1787779483.507567:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505026432 00000100:00100000:3.0:1787779483.507623:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 118 00000100:00100000:3.0:1787779483.507634:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+8:5605:x1874622505026432:12345-192.168.201.9@tcp:502: 00000100:00100000:3.0:1787779483.508072:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+8:5605:x1874622505026432:12345-192.168.201.9@tcp:502: Request processed in 438us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779483.508081:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 118 00000100:00100000:0.0:1787779483.538743:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779483.538859:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505026560 00000100:00100000:3.0:1787779483.538869:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505026560 00000100:00100000:3.0:1787779483.538923:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 119 00000100:00100000:3.0:1787779483.538934:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+8:5605:x1874622505026560:12345-192.168.201.9@tcp:502: 00000100:00100000:3.0:1787779483.539269:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+8:5605:x1874622505026560:12345-192.168.201.9@tcp:502: Request processed in 335us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779483.539769:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 119 00000100:00100000:3.0:1787779483.561080:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779483.561242:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505026688 00000100:00100000:1.0:1787779483.561253:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505026688 00000100:00100000:1.0:1787779483.561307:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 120 00000100:00100000:1.0:1787779483.561320:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+8:5587:x1874622505026688:12345-192.168.201.9@tcp:101: 00010000:00010000:1.0:1787779483.561350:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779483.561370:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e8429d4c00/0x9e63ba8af6888f36 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedab37 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779483.561416:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e8429d4c00/0x9e63ba8af6888f36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedab37 expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779483.561429:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e8429d4c00/0x9e63ba8af6888f36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedab37 expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779483.561439:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e8429d4c00, rc 0) 00000100:00100000:1.0:1787779483.561495:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+9:5587:x1874622505026688:12345-192.168.201.9@tcp:101: Request processed in 178us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779483.561503:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 120 00000100:00100000:2.0:1787779483.564807:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779483.565580:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505026816 00000100:00100000:3.0:1787779483.565593:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505026816 00000100:00100000:3.0:1787779483.565652:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 121 00000100:00100000:3.0:1787779483.565662:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+9:5587:x1874622505026816:12345-192.168.201.9@tcp:256: 20000000:01000000:3.0:1787779483.565686:0:5828:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787779483.565705:0:5828:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787779483.565731:0:5828:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787779483.565736:0:5828:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787779483.565739:0:5828:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1787779483.568736:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+9:5587:x1874622505026816:12345-192.168.201.9@tcp:256: Request processed in 3047us (3911us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779483.568750:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 121 00000100:00100000:3.0:1787779483.581862:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779483.581896:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505026944 00000100:00100000:3.0:1787779483.581906:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505026944 00000100:00100000:3.0:1787779483.581956:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 122 00000100:00100000:3.0:1787779483.581967:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+9:5587:x1874622505026944:12345-192.168.201.9@tcp:101: 00010000:00010000:3.0:1787779483.581985:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779483.582002:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e882049a00/0x9e63ba8af6888f3d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedab3e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779483.582031:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e882049a00/0x9e63ba8af6888f3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedab3e expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779483.582043:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e882049a00/0x9e63ba8af6888f3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedab3e expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779483.582052:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e882049a00, rc 0) 00000100:00100000:3.0:1787779483.582108:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+10:5587:x1874622505026944:12345-192.168.201.9@tcp:101: Request processed in 144us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779483.582125:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 122 00000100:00100000:2.0:1787779483.585146:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779483.585184:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505027072 00000100:00100000:2.0:1787779483.585193:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505027072 00000100:00100000:2.0:1787779483.585246:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 123 00000100:00100000:2.0:1787779483.585256:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+10:5587:x1874622505027072:12345-192.168.201.9@tcp:501: 00000100:00100000:2.0:1787779483.585588:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+10:5587:x1874622505027072:12345-192.168.201.9@tcp:501: Request processed in 333us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779483.585596:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 123 00000100:00100000:3.0:1787779483.599574:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779483.599748:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505027200 00000100:00100000:2.0:1787779483.599759:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505027200 00000100:00100000:2.0:1787779483.599818:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 124 00000100:00100000:2.0:1787779483.599828:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+10:5587:x1874622505027200:12345-192.168.201.9@tcp:503: 00000100:00100000:2.0:1787779483.600176:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+10:5587:x1874622505027200:12345-192.168.201.9@tcp:503: Request processed in 347us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779483.600184:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 124 00000100:00100000:0.0:1787779483.604497:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779483.604594:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505027328 00000100:00100000:3.0:1787779483.604607:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505027328 00000100:00100000:3.0:1787779483.604672:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 125 00000100:00100000:3.0:1787779483.604683:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+10:5608:x1874622505027328:12345-192.168.201.9@tcp:502: 00000100:00100000:3.0:1787779483.605036:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+10:5608:x1874622505027328:12345-192.168.201.9@tcp:502: Request processed in 354us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779483.605045:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 125 00000100:00100000:2.0:1787779483.610389:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779483.610498:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505027456 00000100:00100000:1.0:1787779483.610508:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505027456 00000100:00100000:1.0:1787779483.610567:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 126 00000100:00100000:1.0:1787779483.610577:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+10:5608:x1874622505027456:12345-192.168.201.9@tcp:502: 00000100:00100000:1.0:1787779483.610853:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+10:5608:x1874622505027456:12345-192.168.201.9@tcp:502: Request processed in 277us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779483.610863:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 126 00000100:00100000:3.0:1787779483.613871:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779483.615605:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505027584 00000100:00100000:2.0:1787779483.615618:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505027584 00000100:00100000:3.0:1787779483.615956:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 4 00000100:00100000:3.0:1787779483.615966:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a70b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2356:x1874622505027584:12345-192.168.201.9@tcp:38: 00010000:00080000:3.0:1787779483.615998:0:5836:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from e225400f-8d32-48a8-ab5e-fe4d3780a20c@192.168.201.9@tcp t0 exp 0000000000000000 cur 249 last 0 00000020:00000080:3.0:1787779483.616046:0:5836:0:(genops.c:1385:class_connect()) connect: client e225400f-8d32-48a8-ab5e-fe4d3780a20c, cookie 0x9e63ba8af6888f44 00000004:00100000:3.0:1787779483.616077:0:5836:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1787779483.616085:0:5836:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:3.0:1787779483.634388:0:5836:0:(import.c:65:import_set_state_nolock()) ffff98e881a4e000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787779483.634475:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a70b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:2356:x1874622505027584:12345-192.168.201.9@tcp:38: Request processed in 18507us (20611us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779483.634488:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 4 00000100:00100000:0.0:1787779484.085228:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87aa552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1874622524972928:0@lo:400: 00000100:00100000:2.0:1787779484.085313:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87aa54b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622524973056:0@lo:400: 00000100:00100000:0.0:1787779484.085313:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779484.085360:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779484.085396:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787779484.085403:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87aa55680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874622524972800:0@lo:400: 00000100:00100000:1.0:1787779484.085425:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87aa54f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c28aae66-2825-42c5-8f52-61f687e868c9:3307:1874622524972672:0@lo:400: 00000100:00100000:0.0:1787779484.085426:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779484.085441:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87aa54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874622524973312:0@lo:400: 00000100:00100000:0.0:1787779484.085464:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779484.085469:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779484.085487:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87aa57840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1874622524973184:0@lo:400: 00000100:00100000:0.0:1787779484.085498:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524972928 00000100:00100000:0.0:1787779484.085505:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524972928 00000100:00100000:1.0:1787779484.085506:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779484.085547:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524973056 00000100:00100000:1.0:1787779484.085551:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524973056 00000100:00100000:0.0:1787779484.085555:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524972800 00000100:00100000:0.0:1787779484.085557:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524972800 00000100:00100000:1.0:1787779484.085574:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524973312 00000100:00100000:1.0:1787779484.085577:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524973312 00000100:00100000:0.0:1787779484.085582:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524973184 00000100:00100000:0.0:1787779484.085584:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524973184 00000100:00100000:1.0:1787779484.085595:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787779484.085597:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787779484.085606:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e855b00b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874622524972928:12345-0@lo:400: 00000100:00100000:1.0:1787779484.085617:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e855b3d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622524973056:12345-0@lo:400: 00000100:00100000:1.0:1787779484.085654:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e855b3d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622524973056:12345-0@lo:400: Request processed in 37us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779484.085661:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787779484.085691:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787779484.085698:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e855b02580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874622524973312:12345-0@lo:400: 00000100:00100000:1.0:1787779484.085747:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e855b02580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874622524973312:12345-0@lo:400: Request processed in 50us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779484.085753:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787779484.085776:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524972672 00000100:00100000:1.0:1787779484.085780:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524972672 00000100:00100000:1.0:1787779484.085803:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787779484.085809:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+19:3307:x1874622524972672:12345-0@lo:400: 00000100:00100000:1.0:1787779484.085839:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+19:3307:x1874622524972672:12345-0@lo:400: Request processed in 30us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779484.085856:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787779484.085899:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87aa54f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c28aae66-2825-42c5-8f52-61f687e868c9:3307:1874622524972672:0@lo:400: 00010000:00080000:1.0:1787779484.085945:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e87aa54000 x1874622524973312/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779484.085956:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1787779484.085973:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87aa54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874622524973312:0@lo:400: 00010000:00080000:1.0:1787779484.085983:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e87aa552c0 x1874622524972928/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779484.085992:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87aa552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1874622524972928:0@lo:400: 00000100:00100000:1.0:1787779484.086019:0:5837:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1787779484.086031:0:5837:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1787779484.086054:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e855b00b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874622524972928:12345-0@lo:400: Request processed in 448us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779484.086061:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787779484.086075:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787779484.086081:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e855b021c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874622524972800:12345-0@lo:400: 00000100:00100000:0.0:1787779484.086119:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e855b021c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874622524972800:12345-0@lo:400: Request processed in 39us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779484.086125:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787779484.086136:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787779484.086142:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ece5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874622524973184:12345-0@lo:400: 00000100:00100000:0.0:1787779484.086172:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ece5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874622524973184:12345-0@lo:400: Request processed in 31us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779484.086184:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1787779484.086296:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e87aa57840 x1874622524973184/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779484.086306:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87aa57840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1874622524973184:0@lo:400: 00000100:00080000:3.0:1787779484.086318:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787779484.086334:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787779484.086494:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e87aa55680 x1874622524972800/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779484.086503:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87aa55680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874622524972800:0@lo:400: 00010000:00080000:2.0:1787779484.099866:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e87aa54b40 x1874622524973056/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779484.099906:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87aa54b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622524973056:0@lo:400: 00010000:00010000:1.0:1787779484.275023:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779484.595031:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787779484.595059:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855b03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874622524973440:0@lo:13: 00000100:00100000:3.0:1787779484.595125:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779484.595688:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524973440 00000100:00100000:2.0:1787779484.595706:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524973440 00000100:00100000:2.0:1787779484.595904:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787779484.595913:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a708780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874622524973440:12345-0@lo:13: 00002000:00000024:2.0:1787779484.595949:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787779484.596149:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a708780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874622524973440:12345-0@lo:13: Request processed in 236us (1022us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779484.596157:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1787779484.601564:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e855b03480 x1874622524973440/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779500 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779484.601598:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855b03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874622524973440:0@lo:13: 00000100:00100000:1.0:1787779484.643208:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779484.643426:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505027840 00000100:00100000:2.0:1787779484.643436:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505027840 00000100:00100000:2.0:1787779484.643525:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 5 00000100:00100000:2.0:1787779484.643534:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ece52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:5587:x1874622505027840:12345-192.168.201.9@tcp:41: 00000004:00000024:2.0:1787779484.643576:0:5835:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1787779484.643637:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ece52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:5587:x1874622505027840:12345-192.168.201.9@tcp:41: Request processed in 104us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779484.643645:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 5 00000100:00080000:3.0:1787779484.644362:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787779484.644408:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779484.644975:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505027712 00000100:00100000:2.0:1787779484.644983:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505027712 00000100:00100000:2.0:1787779484.645036:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 6 00000100:00100000:2.0:1787779484.645046:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a708000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:0:x1874622505027712:12345-192.168.201.9@tcp:41: 00000004:00000024:2.0:1787779484.645069:0:5837:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1787779484.645133:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a708000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:0:x1874622505027712:12345-192.168.201.9@tcp:41: Request processed in 88us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779484.645140:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 6 00000100:00100000:3.0:1787779484.652909:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779484.653057:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505027968 00000100:00100000:2.0:1787779484.653067:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505027968 00000100:00100000:2.0:1787779484.653152:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 7 00000100:00100000:2.0:1787779484.653163:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a70ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:5587:x1874622505027968:12345-192.168.201.9@tcp:40: 00000100:00100000:2.0:1787779484.653260:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a70ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:5587:x1874622505027968:12345-192.168.201.9@tcp:40: Request processed in 100us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779484.653269:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 7 00000100:00100000:1.0:1787779484.656839:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779484.656885:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779484.657146:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505028352 00000100:00100000:2.0:1787779484.657157:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505028352 00000100:00100000:2.0:1787779484.657222:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 128 00000100:00100000:2.0:1787779484.657232:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e844dc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+10:2358:x1874622505028352:12345-192.168.201.9@tcp:400: 00000100:00100000:2.0:1787779484.657333:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e844dc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+10:2358:x1874622505028352:12345-192.168.201.9@tcp:400: Request processed in 101us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779484.657340:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 128 00000100:00100000:3.0:1787779484.658869:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505028480 00000100:00100000:3.0:1787779484.658881:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505028480 00000100:00100000:3.0:1787779484.658930:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 0 00000100:00100000:3.0:1787779484.658944:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ece7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:5587:x1874622505028480:12345-192.168.201.9@tcp:33: 00000100:00100000:2.0:1787779484.658946:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779484.658986:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779484.659010:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505028096 00000100:00100000:2.0:1787779484.659015:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505028096 00000100:00100000:2.0:1787779484.659040:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505028224 00000100:00100000:2.0:1787779484.659043:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505028224 00000100:00100000:3.0:1787779484.659054:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 8 00000100:00100000:3.0:1787779484.659060:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e855b3cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2356:x1874622505028096:12345-192.168.201.9@tcp:8: 00010000:00080000:3.0:1787779484.659081:0:6681:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from e225400f-8d32-48a8-ab5e-fe4d3780a20c@192.168.201.9@tcp t0 exp 0000000000000000 cur 250 last 0 00000020:00000080:2.0:1787779484.659451:0:6681:0:(genops.c:1385:class_connect()) connect: client e225400f-8d32-48a8-ab5e-fe4d3780a20c, cookie 0x9e63ba8af6888f4b 00002000:00100000:2.0:1787779484.659667:0:6681:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e225400f-8d32-48a8-ab5e-fe4d3780a20c/ffff98e87a9f7000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113939 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787779484.659792:0:6681:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787779484.660206:0:6681:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787779484.660254:0:6681:0:(import.c:65:import_set_state_nolock()) ffff98e87a9f4000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787779484.660470:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e855b3cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:2356:x1874622505028096:12345-192.168.201.9@tcp:8: Request processed in 1407us (1528us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779484.660500:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 8 00000100:00100000:2.0:1787779484.660534:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 9 00000100:00100000:2.0:1787779484.660540:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e855b3d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2356:x1874622505028224:12345-192.168.201.9@tcp:8: 00010000:00080000:2.0:1787779484.660561:0:6681:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from e225400f-8d32-48a8-ab5e-fe4d3780a20c@192.168.201.9@tcp t0 exp 0000000000000000 cur 250 last 0 00000020:00000080:2.0:1787779484.660582:0:6681:0:(genops.c:1385:class_connect()) connect: client e225400f-8d32-48a8-ab5e-fe4d3780a20c, cookie 0x9e63ba8af6888f52 00002000:00100000:2.0:1787779484.660590:0:6681:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e225400f-8d32-48a8-ab5e-fe4d3780a20c/ffff98e87a9f4800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113939 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787779484.660596:0:6681:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787779484.660919:0:6681:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787779484.660939:0:6681:0:(import.c:65:import_set_state_nolock()) ffff98e87a9f6800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787779484.660968:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e855b3d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:2356:x1874622505028224:12345-192.168.201.9@tcp:8: Request processed in 427us (1982us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779484.660975:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 9 00000004:00080000:3.0:1787779484.682327:0:5838:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 23317us 00000004:00200000:0.0:1787779484.728849:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1787779484.729037:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ece7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:5587:x1874622505028480:12345-192.168.201.9@tcp:33: Request processed in 70093us (72146us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779484.729052:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 0 00000100:00100000:2.0:1787779485.007554:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779485.007770:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505028608 00000100:00100000:1.0:1787779485.007781:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505028608 00000100:00100000:1.0:1787779485.007847:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 8 00000100:00100000:1.0:1787779485.007857:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e853585e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:5625:x1874622505028608:12345-192.168.201.9@tcp:101: 00010000:00010000:1.0:1787779485.007877:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779485.007904:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5600/0x9e63ba8af6888f59 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedab68 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779485.007976:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4200/0x9e63ba8af6888f60 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779485.007989:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4200/0x9e63ba8af6888f60 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779485.008002:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4200/0x9e63ba8af6888f60 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787779485.008230:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1787779485.008234:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787779485.008322:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4200/0x9e63ba8af6888f60 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779485.008365:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5600/0x9e63ba8af6888f59 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedab68 expref: 8 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779485.008386:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4200/0x9e63ba8af6888f60 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedab68 expref: 7 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779485.008395:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e860c40800) 00010000:00010000:1.0:1787779485.008398:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787779485.008401:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e8429d4200, rc 0) 00000100:00100000:1.0:1787779485.008484:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e853585e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+7:5625:x1874622505028608:12345-192.168.201.9@tcp:101: Request processed in 628us (940us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779485.008492:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 8 00010000:00010000:3.0:1787779485.298981:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779486.323442:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779487.310305:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779487.310456:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505028736 00000100:00100000:2.0:1787779487.310467:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505028736 00000100:00100000:2.0:1787779487.310546:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 9 00000100:00100000:2.0:1787779487.310558:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ece5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+7:5677:x1874622505028736:12345-192.168.201.9@tcp:41: 00000004:00000024:2.0:1787779487.310608:0:5835:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1787779487.310692:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ece5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+7:5677:x1874622505028736:12345-192.168.201.9@tcp:41: Request processed in 136us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779487.310699:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 9 00000100:00080000:3.0:1787779487.310977:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787779487.321737:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779487.325944:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505028864 00000100:00100000:0.0:1787779487.325959:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505028864 00000100:00100000:0.0:1787779487.326039:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 9 00000100:00100000:0.0:1787779487.326051:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f6b6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:5677:x1874622505028864:12345-192.168.201.9@tcp:13: 00002000:00000024:0.0:1787779487.326090:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787779487.326160:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f6b6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:5677:x1874622505028864:12345-192.168.201.9@tcp:13: Request processed in 111us (4458us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779487.326168:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 9 00000100:00080000:3.0:1787779487.326385:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787779487.328779:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779487.328875:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505028992 00000100:00100000:0.0:1787779487.328893:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505028992 00000100:00100000:0.0:1787779487.328962:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 10 00000100:00100000:0.0:1787779487.328972:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ece7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:5677:x1874622505028992:12345-192.168.201.9@tcp:13: 00002000:00000024:0.0:1787779487.329010:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787779487.329081:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ece7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:5677:x1874622505028992:12345-192.168.201.9@tcp:13: Request processed in 110us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779487.329088:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 10 00000100:00080000:3.0:1787779487.329198:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787779487.346909:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779488.180196:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f6b70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622524973568:0@lo:13: 00000100:00100000:1.0:1787779488.180295:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779488.180422:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524973568 00000100:00100000:2.0:1787779488.180431:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524973568 00000100:00100000:2.0:1787779488.180490:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787779488.180512:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ece4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622524973568:12345-0@lo:13: 00002000:00000024:2.0:1787779488.180535:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787779488.180579:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ece4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622524973568:12345-0@lo:13: Request processed in 69us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779488.180586:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1787779488.180633:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e87f6b70c0 x1874622524973568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779504 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779488.180651:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f6b70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622524973568:0@lo:13: 00000100:00080000:1.0:1787779488.180702:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:3.0:1787779488.236882:0:6704:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e225400f-8d32-48a8-ab5e-fe4d3780a20c 00010000:00010000:1.0:1787779488.372436:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787779488.777612:0:8071:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e225400f-8d32-48a8-ab5e-fe4d3780a20c 00000001:00100000:0.0:1787779488.800959:0:5857:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e225400f-8d32-48a8-ab5e-fe4d3780a20c 00000100:00100000:1.0:1787779489.203738:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ece6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1874622524973952:0@lo:400: 00000100:00100000:1.0:1787779489.203835:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779489.203915:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787779489.203921:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ece6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874622524973824:0@lo:400: 00000100:00100000:1.0:1787779489.203942:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779489.203958:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ece6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874622524974336:0@lo:400: 00000100:00100000:1.0:1787779489.203977:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779489.204030:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524973952 00000100:00100000:1.0:1787779489.204037:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524973952 00000100:00100000:1.0:1787779489.204086:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524973824 00000100:00100000:1.0:1787779489.204089:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524973824 00000100:00100000:1.0:1787779489.204108:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787779489.204115:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87aa54b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874622524973952:12345-0@lo:400: 00000100:00100000:1.0:1787779489.204174:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87aa54b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874622524973952:12345-0@lo:400: Request processed in 59us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779489.204181:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787779489.204196:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787779489.204201:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87aa55680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874622524973824:12345-0@lo:400: 00000100:00100000:1.0:1787779489.204223:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87aa55680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874622524973824:12345-0@lo:400: Request processed in 23us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779489.204229:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787779489.204262:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524974336 00000100:00100000:1.0:1787779489.204265:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524974336 00000100:00100000:1.0:1787779489.204289:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787779489.204295:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87aa57840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874622524974336:12345-0@lo:400: 00000100:00100000:1.0:1787779489.204323:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87aa57840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874622524974336:12345-0@lo:400: Request processed in 28us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779489.204328:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1787779489.204343:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787779489.204348:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787779489.204594:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ece6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874622524973824:0@lo:400: 00010000:00080000:1.0:1787779489.204607:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e87ece6940 x1874622524974336/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779505 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779489.204618:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ece6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874622524974336:0@lo:400: 00000100:00100000:1.0:1787779489.204640:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ece6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1874622524973952:0@lo:400: 00000100:00100000:3.0:1787779489.206775:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ece5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c28aae66-2825-42c5-8f52-61f687e868c9:3307:1874622524973696:0@lo:400: 00000100:00100000:3.0:1787779489.206860:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779489.206995:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ece4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622524974080:0@lo:400: 00000100:00100000:2.0:1787779489.207033:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779489.207098:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524974080 00000100:00100000:2.0:1787779489.207106:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524974080 00000100:00100000:2.0:1787779489.207166:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787779489.207177:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f6b4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622524974080:12345-0@lo:400: 00000100:00100000:3.0:1787779489.207243:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ece43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1874622524974208:0@lo:400: 00000100:00100000:2.0:1787779489.207250:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f6b4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622524974080:12345-0@lo:400: Request processed in 74us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779489.207262:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787779489.207296:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1787779489.207312:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e87ece4f00 x1874622524974080/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779505 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779489.207327:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ece4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622524974080:0@lo:400: 00000100:00100000:3.0:1787779489.207335:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524974208 00000100:00100000:3.0:1787779489.207340:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524974208 00000100:00080000:2.0:1787779489.207388:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787779489.207399:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787779489.207407:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a70a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874622524974208:12345-0@lo:400: 00000100:00100000:3.0:1787779489.207453:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a70a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874622524974208:12345-0@lo:400: Request processed in 48us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779489.207460:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787779489.207847:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ece43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1874622524974208:0@lo:400: 00000100:00100000:0.0:1787779489.208876:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524973696 00000100:00100000:0.0:1787779489.208885:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524973696 00000100:00100000:0.0:1787779489.208932:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787779489.208942:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e844dc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+19:3307:x1874622524973696:12345-0@lo:400: 00000100:00100000:0.0:1787779489.209024:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e844dc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+19:3307:x1874622524973696:12345-0@lo:400: Request processed in 84us (2164us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779489.209031:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787779489.209249:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ece5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c28aae66-2825-42c5-8f52-61f687e868c9:3307:1874622524973696:0@lo:400: 00010000:00010000:3.0:1787779489.395079:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779489.714895:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787779489.714926:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855b00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874622524974464:0@lo:13: 00000100:00100000:3.0:1787779489.715005:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779489.715292:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524974464 00000100:00100000:0.0:1787779489.715301:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524974464 00000100:00100000:0.0:1787779489.715363:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787779489.715373:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a709e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874622524974464:12345-0@lo:13: 00002000:00000024:0.0:1787779489.715426:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787779489.715485:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a709e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874622524974464:12345-0@lo:13: Request processed in 113us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779489.715493:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1787779489.715847:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e855b00000 x1874622524974464/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779505 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779489.715866:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855b00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874622524974464:0@lo:13: 00000100:00100000:1.0:1787779489.956973:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779489.957014:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779489.957044:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779489.957064:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505029120 00000100:00100000:1.0:1787779489.957071:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779489.957077:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505029120 00000100:00100000:1.0:1787779489.957090:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505029376 00000100:00100000:1.0:1787779489.957095:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505029376 00000100:00100000:3.0:1787779489.957128:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 130 00000100:00100000:3.0:1787779489.957138:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e844dc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+10:2359:x1874622505029120:12345-192.168.201.9@tcp:400: 00000100:00100000:1.0:1787779489.957143:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505029504 00000100:00100000:1.0:1787779489.957146:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505029504 00000100:00100000:3.0:1787779489.957251:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e844dc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+10:2359:x1874622505029120:12345-192.168.201.9@tcp:400: Request processed in 113us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779489.957259:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 130 00000100:00100000:1.0:1787779489.957352:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 10 00000100:00100000:1.0:1787779489.957361:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87aa552c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+5:2359:x1874622505029376:12345-192.168.201.9@tcp:400: 00000100:00100000:1.0:1787779489.957566:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87aa552c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+5:2359:x1874622505029376:12345-192.168.201.9@tcp:400: Request processed in 206us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779489.957574:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 10 00000100:00100000:1.0:1787779489.957590:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 11 00000100:00100000:1.0:1787779489.957596:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87aa54f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+5:2359:x1874622505029504:12345-192.168.201.9@tcp:400: 00000100:00100000:1.0:1787779489.957622:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87aa54f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+5:2359:x1874622505029504:12345-192.168.201.9@tcp:400: Request processed in 26us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779489.957628:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 11 00000100:00100000:1.0:1787779489.957647:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505029248 00000100:00100000:1.0:1787779489.957651:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505029248 00000100:00100000:1.0:1787779489.957694:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 25 00000100:00100000:1.0:1787779489.957701:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87aa54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:2359:x1874622505029248:12345-192.168.201.9@tcp:400: 00000100:00080000:2.0:1787779489.957870:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787779489.957875:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787779489.957888:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787779489.959094:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87aa54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:2359:x1874622505029248:12345-192.168.201.9@tcp:400: Request processed in 1385us (2040us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779489.959134:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 25 00010000:00010000:1.0:1787779490.420490:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787779490.486123:0:8289:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1787779491.442953:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779492.470048:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787779493.308679:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f6b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622524974592:0@lo:13: 00000100:00100000:2.0:1787779493.309225:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779493.310429:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524974592 00000100:00100000:3.0:1787779493.310442:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524974592 00000100:00100000:3.0:1787779493.310501:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787779493.310511:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f6b6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622524974592:12345-0@lo:13: 00002000:00000024:3.0:1787779493.310549:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787779493.310620:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f6b6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622524974592:12345-0@lo:13: Request processed in 109us (1394us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779493.310635:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1787779493.311065:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787779493.311374:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e87f6b4000 x1874622524974592/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779509 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779493.311397:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f6b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622524974592:0@lo:13: 00010000:00010000:3.0:1787779493.493026:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779494.323835:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855b02d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874622524974848:0@lo:400: 00000100:00100000:0.0:1787779494.323943:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779494.324005:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855b03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874622524975360:0@lo:400: 00000100:00100000:0.0:1787779494.324034:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779494.324064:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787779494.324070:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855b003c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874622524974976:0@lo:400: 00000100:00100000:0.0:1787779494.324092:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779494.324619:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855b03c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c28aae66-2825-42c5-8f52-61f687e868c9:3307:1874622524974720:0@lo:400: 00000100:00100000:2.0:1787779494.324654:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779494.324677:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855b00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1874622524975232:0@lo:400: 00000100:00100000:2.0:1787779494.324697:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779494.324791:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855b00f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622524975104:0@lo:400: 00000100:00100000:3.0:1787779494.324821:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779494.324860:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524975360 00000100:00100000:3.0:1787779494.324867:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524975360 00000100:00100000:3.0:1787779494.324916:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524975104 00000100:00100000:3.0:1787779494.324919:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524975104 00000100:00100000:3.0:1787779494.324936:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787779494.324946:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842fede00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874622524975360:12345-0@lo:400: 00000100:00100000:3.0:1787779494.324998:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842fede00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874622524975360:12345-0@lo:400: Request processed in 53us (963us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779494.325005:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787779494.325020:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787779494.325027:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a7092c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622524975104:12345-0@lo:400: 00000100:00100000:3.0:1787779494.325074:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a7092c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622524975104:12345-0@lo:400: Request processed in 48us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779494.325080:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1787779494.325249:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e855b00f00 x1874622524975104/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779510 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779494.325263:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855b00f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622524975104:0@lo:400: 00000100:00080000:3.0:1787779494.325294:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787779494.325323:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524974720 00000100:00100000:3.0:1787779494.325326:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524974720 00000100:00100000:3.0:1787779494.325352:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787779494.325359:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842effc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+19:3307:x1874622524974720:12345-0@lo:400: 00000100:00100000:3.0:1787779494.325403:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842effc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+19:3307:x1874622524974720:12345-0@lo:400: Request processed in 45us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779494.325409:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00010000:00080000:3.0:1787779494.325653:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e855b03480 x1874622524975360/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779510 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779494.325663:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855b03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874622524975360:0@lo:400: 00000100:00100000:1.0:1787779494.331674:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524974848 00000100:00100000:1.0:1787779494.331692:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524974848 00000100:00100000:1.0:1787779494.331806:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524974976 00000100:00100000:1.0:1787779494.331810:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524974976 00000100:00100000:1.0:1787779494.331846:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787779494.331856:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842fee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874622524974848:12345-0@lo:400: 00000100:00100000:1.0:1787779494.331962:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842fee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874622524974848:12345-0@lo:400: Request processed in 108us (8019us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779494.331969:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787779494.331987:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787779494.331994:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842fefc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874622524974976:12345-0@lo:400: 00000100:00100000:1.0:1787779494.332024:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842fefc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874622524974976:12345-0@lo:400: Request processed in 30us (7930us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779494.332029:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:1.0:1787779494.332076:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787779494.332116:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855b003c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874622524974976:0@lo:400: 00000100:00100000:1.0:1787779494.332129:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855b02d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874622524974848:0@lo:400: 00000100:00100000:2.0:1787779494.334367:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855b03c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c28aae66-2825-42c5-8f52-61f687e868c9:3307:1874622524974720:0@lo:400: 00000100:00100000:1.0:1787779494.337622:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524975232 00000100:00100000:1.0:1787779494.337638:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524975232 00000100:00100000:1.0:1787779494.337744:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787779494.337754:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f6b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874622524975232:12345-0@lo:400: 00000100:00080000:3.0:1787779494.337864:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787779494.337870:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f6b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874622524975232:12345-0@lo:400: Request processed in 119us (13172us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779494.337896:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787779494.337935:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855b00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1874622524975232:0@lo:400: 00010000:00010000:0.0:1787779494.514879:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779494.853967:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e842fecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874622524975488:0@lo:13: 00000100:00100000:1.0:1787779494.854043:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779494.854266:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524975488 00000100:00100000:0.0:1787779494.854275:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524975488 00000100:00100000:0.0:1787779494.854343:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787779494.854352:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ece6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874622524975488:12345-0@lo:13: 00002000:00000024:0.0:1787779494.854389:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787779494.854450:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ece6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874622524975488:12345-0@lo:13: Request processed in 99us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779494.854458:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1787779494.854531:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e842fecb40 x1874622524975488/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779510 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779494.854561:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e842fecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874622524975488:0@lo:13: 00000020:00000080:0.0:1787779494.964212:0:8438:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffef95449c0 20000000:00000080:0.0:1787779494.964283:0:8438:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98e87a9e6800 uarg=0000000000000000 20000000:01000000:0.0:1787779494.964322:0:8438:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1787779494.964324:0:8438:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1787779494.964327:0:8438:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1787779494.964331:0:8438:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1787779494.964337:0:8438:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1787779494.964351:0:8438:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787779494.964354:0:8438:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1787779494.964577:0:8438:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1787779494.964581:0:8438:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787779494.966452:0:8439:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:0.0:1787779494.967326:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:0.0:1787779494.967406:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:0.0:1787779494.967443:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:0.0:1787779494.967455:0:8438:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787779494.967457:0:8438:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787779494.969405:0:8440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:0.0:1787779494.970382:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:0.0:1787779494.970434:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:0.0:1787779494.970466:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:0.0:1787779494.970478:0:8438:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787779494.970480:0:8438:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787779494.975943:0:8441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:0.0:1787779494.976496:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:0.0:1787779494.976817:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:0.0:1787779494.976905:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:0.0:1787779494.976919:0:8438:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1787779494.976927:0:8438:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787779494.979237:0:8442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1787779494.983098:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1787779494.983867:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:0.0:1787779494.983943:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 10000000:01000000:0.0:1787779494.983965:0:8438:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787779494.983984:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98e848f68a00/0x9e63ba8af6888f67 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779494.984001:0:8438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98e848f68c00/0x9e63ba8af6888e64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af6888e5d expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779494.984009:0:8438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98e848f69800/0x9e63ba8af6888e8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af6888e87 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779494.984015:0:8438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98e8429d5800/0x9e63ba8af6888eb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af6888eb1 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779494.984020:0:8438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98e8429d5c00/0x9e63ba8af6888ec6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af6888ebf expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779494.984027:0:8438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98e848f68e00/0x9e63ba8af6888ed4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af6888ecd expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779494.984033:0:8438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98e882048a00/0x9e63ba8af6888ef0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af6888ee9 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779494.984039:0:8438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98e841648e00/0x9e63ba8af6888f1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af6888f0c expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779494.984049:0:8438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98e8429d4000/0x9e63ba8af6888f28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedab06 expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779494.984072:0:8438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98e8429d4a00/0x9e63ba8af6888f2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedab0d expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779494.984079:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98e848f68a00/0x9e63ba8af6888f67 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779494.984475:0:8438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98e8429d4a00/0x9e63ba8af6888f2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedab0d expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779494.984491:0:8438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98e8429d4a00/0x9e63ba8af6888f2f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedab0d expref: 9 pid: 5828 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779494.984506:0:8438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e842fef480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8438:1874622524975616:192.168.201.9@tcp:104: 00010000:00010000:0.0:1787779494.985325:0:8438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98e8429d4000/0x9e63ba8af6888f28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedab06 expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779494.985515:0:8438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98e8429d4000/0x9e63ba8af6888f28 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedab06 expref: 9 pid: 5830 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779494.985528:0:8438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e842feda40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8438:1874622524975744:192.168.201.9@tcp:104: 00010000:00010000:0.0:1787779494.985585:0:8438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98e841648e00/0x9e63ba8af6888f1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9e63ba8af6888f0c expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779494.985593:0:8438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98e841648e00/0x9e63ba8af6888f1a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9e63ba8af6888f0c expref: 18 pid: 5830 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779494.985604:0:8438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e842fee1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8438:1874622524975872:0@lo:104: 00000100:00100000:0.0:1787779494.986010:0:8438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787779494.986123:0:8438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98e882048a00/0x9e63ba8af6888ef0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9e63ba8af6888ee9 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779494.986142:0:8438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98e882048a00/0x9e63ba8af6888ef0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9e63ba8af6888ee9 expref: 18 pid: 5828 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779494.986151:0:8438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e842fecf00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8438:1874622524976000:0@lo:104: 00000100:00100000:0.0:1787779494.986178:0:8438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787779494.989001:0:8438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98e848f68e00/0x9e63ba8af6888ed4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9e63ba8af6888ecd expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779494.989019:0:8438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98e848f68e00/0x9e63ba8af6888ed4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9e63ba8af6888ecd expref: 18 pid: 5830 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779494.989034:0:8438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e842fed680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8438:1874622524976128:0@lo:104: 00010000:00010000:0.0:1787779494.989084:0:8438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98e8429d5c00/0x9e63ba8af6888ec6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9e63ba8af6888ebf expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779494.989093:0:8438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98e8429d5c00/0x9e63ba8af6888ec6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9e63ba8af6888ebf expref: 18 pid: 5830 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779494.989102:0:8438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e842fed2c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8438:1874622524976256:0@lo:104: 00010000:00010000:0.0:1787779494.989148:0:8438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98e8429d5800/0x9e63ba8af6888eb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9e63ba8af6888eb1 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779494.989155:0:8438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98e8429d5800/0x9e63ba8af6888eb8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9e63ba8af6888eb1 expref: 18 pid: 5831 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779494.989163:0:8438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e842fee940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8438:1874622524976384:0@lo:104: 00010000:00010000:0.0:1787779494.989184:0:8438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98e848f69800/0x9e63ba8af6888e8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9e63ba8af6888e87 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779494.989206:0:8438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98e848f69800/0x9e63ba8af6888e8e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9e63ba8af6888e87 expref: 18 pid: 5831 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779494.989213:0:8438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e842fef840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8438:1874622524976512:0@lo:104: 00010000:00010000:0.0:1787779494.989240:0:8438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98e848f68c00/0x9e63ba8af6888e64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9e63ba8af6888e5d expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779494.989247:0:8438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98e848f68c00/0x9e63ba8af6888e64 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9e63ba8af6888e5d expref: 18 pid: 5830 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779494.989254:0:8438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e842fef0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8438:1874622524976640:0@lo:104: 00000100:00100000:0.0:1787779494.989269:0:8438:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e84764e780 going to sleep for 11 seconds 00000100:00100000:3.0:1787779494.991490:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787779494.991546:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779494.991883:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779494.991894:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779494.991905:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779494.991914:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779494.991925:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524975872 00000100:00100000:3.0:1787779494.991934:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524975872 00000100:00100000:3.0:1787779494.991982:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524976000 00000100:00100000:3.0:1787779494.991986:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524976000 00000100:00100000:3.0:1787779494.991996:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524976128 00000100:00100000:3.0:1787779494.991997:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524976128 00000100:00100000:3.0:1787779494.992004:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524976256 00000100:00100000:3.0:1787779494.992006:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524976256 00000100:00100000:3.0:1787779494.992013:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524976384 00000100:00100000:3.0:1787779494.992016:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524976384 00000100:00100000:3.0:1787779494.992022:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524976512 00000100:00100000:3.0:1787779494.992024:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524976512 00000100:00100000:3.0:1787779494.992032:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524976640 00000100:00100000:3.0:1787779494.992048:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524976640 00000100:00100000:3.0:1787779494.992067:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787779494.992078:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842fec3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c28aae66-2825-42c5-8f52-61f687e868c9+9:8438:x1874622524975872:12345-0@lo:104: 00010000:00010000:3.0:1787779494.992097:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.109@tcp lock: ffff98e882049c00/0x9e63ba8af6888f0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9e63ba8af6888f1a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779494.992307:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787779494.992314:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842fec3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c28aae66-2825-42c5-8f52-61f687e868c9+9:8438:x1874622524975872:12345-0@lo:104: Request processed in 239us (6305us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779494.992322:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787779494.992356:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787779494.992362:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e845d0f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c28aae66-2825-42c5-8f52-61f687e868c9+8:8438:x1874622524976000:12345-0@lo:104: 00010000:00010000:3.0:1787779494.992372:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.109@tcp lock: ffff98e8429d4400/0x9e63ba8af6888ee9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9e63ba8af6888ef0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779494.992411:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787779494.992416:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e845d0f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c28aae66-2825-42c5-8f52-61f687e868c9+8:8438:x1874622524976000:12345-0@lo:104: Request processed in 55us (6238us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779494.992421:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787779494.992456:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787779494.992462:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a70b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c28aae66-2825-42c5-8f52-61f687e868c9+7:8438:x1874622524976128:12345-0@lo:104: 00010000:00010000:3.0:1787779494.992470:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.109@tcp lock: ffff98e882049000/0x9e63ba8af6888ecd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9e63ba8af6888ed4 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779494.992499:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787779494.992506:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a70b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c28aae66-2825-42c5-8f52-61f687e868c9+7:8438:x1874622524976128:12345-0@lo:104: Request processed in 43us (962us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779494.992511:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787779494.992532:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787779494.992537:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a709a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c28aae66-2825-42c5-8f52-61f687e868c9+6:8438:x1874622524976256:12345-0@lo:104: 00010000:00010000:3.0:1787779494.992545:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.109@tcp lock: ffff98e8429d4e00/0x9e63ba8af6888ebf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9e63ba8af6888ec6 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779494.992820:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1787779494.992825:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a709a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c28aae66-2825-42c5-8f52-61f687e868c9+6:8438:x1874622524976256:12345-0@lo:104: Request processed in 288us (943us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779494.992832:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787779494.992845:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787779494.992851:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a708b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c28aae66-2825-42c5-8f52-61f687e868c9+5:8438:x1874622524976384:12345-0@lo:104: 00010000:00010000:3.0:1787779494.992860:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.109@tcp lock: ffff98e841649000/0x9e63ba8af6888eb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9e63ba8af6888eb8 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779494.992885:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1787779494.992890:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a708b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c28aae66-2825-42c5-8f52-61f687e868c9+5:8438:x1874622524976384:12345-0@lo:104: Request processed in 40us (995us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779494.992896:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787779494.992908:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787779494.992913:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e855b00000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c28aae66-2825-42c5-8f52-61f687e868c9+4:8438:x1874622524976512:12345-0@lo:104: 00010000:00010000:3.0:1787779494.992920:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.109@tcp lock: ffff98e8429d5200/0x9e63ba8af6888e87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9e63ba8af6888e8e expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779494.992945:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:3.0:1787779494.992950:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e855b00000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c28aae66-2825-42c5-8f52-61f687e868c9+4:8438:x1874622524976512:12345-0@lo:104: Request processed in 38us (1044us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779494.992956:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787779494.992977:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787779494.992983:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e855b03c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c28aae66-2825-42c5-8f52-61f687e868c9+3:8438:x1874622524976640:12345-0@lo:104: 00010000:00010000:3.0:1787779494.992990:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.109@tcp lock: ffff98e8429d5a00/0x9e63ba8af6888e5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9e63ba8af6888e64 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779494.993015:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:3.0:1787779494.993019:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e855b03c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c28aae66-2825-42c5-8f52-61f687e868c9+3:8438:x1874622524976640:12345-0@lo:104: Request processed in 37us (1105us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779494.993025:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1787779494.993142:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1787779494.993150:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff98e882049c00/0x9e63ba8af6888f0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9e63ba8af6888f1a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779494.993157:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e882049c00 already unused, calling callback (ffffffffc1cd5c20) 10000000:00010000:2.0:1787779494.993161:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff98e882049c00/0x9e63ba8af6888f0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x9e63ba8af6888f1a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779494.993170:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff98e882049c00/0x9e63ba8af6888f0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x9e63ba8af6888f1a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787779494.993187:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff98e882049c00/0x9e63ba8af6888f0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x9e63ba8af6888f1a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787779494.993193:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787779494.993233:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.109@tcp lock: ffff98e882049c00/0x9e63ba8af6888f0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af6888f1a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779494.993239:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787779494.993256:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff98e882049c00/0x9e63ba8af6888f0c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af6888f1a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779494.993262:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff98e882049c00/0x9e63ba8af6888f0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af6888f1a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779494.993274:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1787779494.993278:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff98e8429d4400/0x9e63ba8af6888ee9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x9e63ba8af6888ef0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779494.993284:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e8429d4400 already unused, calling callback (ffffffffc1cd5c20) 10000000:00010000:2.0:1787779494.993286:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff98e8429d4400/0x9e63ba8af6888ee9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x9e63ba8af6888ef0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779494.993293:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff98e8429d4400/0x9e63ba8af6888ee9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x9e63ba8af6888ef0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787779494.993299:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff98e8429d4400/0x9e63ba8af6888ee9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x9e63ba8af6888ef0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787779494.993305:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787779494.993324:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.109@tcp lock: ffff98e8429d4400/0x9e63ba8af6888ee9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af6888ef0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779494.993330:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787779494.993351:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff98e8429d4400/0x9e63ba8af6888ee9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af6888ef0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779494.993357:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff98e8429d4400/0x9e63ba8af6888ee9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af6888ef0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779494.993368:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1787779494.993372:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff98e882049000/0x9e63ba8af6888ecd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9e63ba8af6888ed4 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779494.993377:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e882049000 already unused, calling callback (ffffffffc1cd5c20) 10000000:00010000:2.0:1787779494.993380:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff98e882049000/0x9e63ba8af6888ecd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x9e63ba8af6888ed4 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779494.993386:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff98e882049000/0x9e63ba8af6888ecd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x9e63ba8af6888ed4 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787779494.993391:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff98e882049000/0x9e63ba8af6888ecd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x9e63ba8af6888ed4 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787779494.993396:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787779494.993409:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.109@tcp lock: ffff98e882049000/0x9e63ba8af6888ecd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af6888ed4 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779494.993414:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787779494.993427:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff98e882049000/0x9e63ba8af6888ecd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af6888ed4 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779494.993446:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff98e882049000/0x9e63ba8af6888ecd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af6888ed4 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779494.993455:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787779494.993458:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff98e8429d4e00/0x9e63ba8af6888ebf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9e63ba8af6888ec6 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779494.993463:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e8429d4e00 already unused, calling callback (ffffffffc1cd5c20) 10000000:00010000:2.0:1787779494.993466:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff98e8429d4e00/0x9e63ba8af6888ebf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x9e63ba8af6888ec6 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779494.993471:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff98e8429d4e00/0x9e63ba8af6888ebf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x9e63ba8af6888ec6 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787779494.993477:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff98e8429d4e00/0x9e63ba8af6888ebf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x9e63ba8af6888ec6 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787779494.993482:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787779494.993496:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.109@tcp lock: ffff98e8429d4e00/0x9e63ba8af6888ebf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af6888ec6 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779494.993502:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787779494.993507:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff98e8429d4e00/0x9e63ba8af6888ebf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af6888ec6 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779494.993513:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff98e8429d4e00/0x9e63ba8af6888ebf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af6888ec6 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779494.993523:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787779494.993532:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff98e841649000/0x9e63ba8af6888eb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9e63ba8af6888eb8 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779494.993538:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e841649000 already unused, calling callback (ffffffffc1cd5c20) 10000000:00010000:2.0:1787779494.993541:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff98e841649000/0x9e63ba8af6888eb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9e63ba8af6888eb8 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779494.993557:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff98e841649000/0x9e63ba8af6888eb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9e63ba8af6888eb8 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787779494.993563:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff98e841649000/0x9e63ba8af6888eb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9e63ba8af6888eb8 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787779494.993569:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787779494.993583:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.109@tcp lock: ffff98e841649000/0x9e63ba8af6888eb1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af6888eb8 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779494.993589:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787779494.993593:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff98e841649000/0x9e63ba8af6888eb1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af6888eb8 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779494.993598:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff98e841649000/0x9e63ba8af6888eb1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af6888eb8 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779494.993608:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787779494.993610:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff98e8429d5200/0x9e63ba8af6888e87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9e63ba8af6888e8e expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779494.993616:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e8429d5200 already unused, calling callback (ffffffffc1cd5c20) 10000000:00010000:2.0:1787779494.993619:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff98e8429d5200/0x9e63ba8af6888e87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9e63ba8af6888e8e expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779494.993941:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff98e8429d5200/0x9e63ba8af6888e87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9e63ba8af6888e8e expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787779494.993948:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff98e8429d5200/0x9e63ba8af6888e87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9e63ba8af6888e8e expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787779494.993953:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787779494.993968:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.109@tcp lock: ffff98e8429d5200/0x9e63ba8af6888e87 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af6888e8e expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779494.993973:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787779494.993978:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff98e8429d5200/0x9e63ba8af6888e87 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af6888e8e expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779494.993984:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff98e8429d5200/0x9e63ba8af6888e87 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af6888e8e expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779494.993994:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787779494.993998:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff98e8429d5a00/0x9e63ba8af6888e5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9e63ba8af6888e64 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779494.994003:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e8429d5a00 already unused, calling callback (ffffffffc1cd5c20) 10000000:00010000:2.0:1787779494.994006:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff98e8429d5a00/0x9e63ba8af6888e5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9e63ba8af6888e64 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779494.994012:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff98e8429d5a00/0x9e63ba8af6888e5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9e63ba8af6888e64 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787779494.994017:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff98e8429d5a00/0x9e63ba8af6888e5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9e63ba8af6888e64 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787779494.994029:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787779494.994043:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.109@tcp lock: ffff98e8429d5a00/0x9e63ba8af6888e5d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af6888e64 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779494.994048:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787779494.994052:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff98e8429d5a00/0x9e63ba8af6888e5d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af6888e64 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779494.994059:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff98e8429d5a00/0x9e63ba8af6888e5d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af6888e64 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779494.994071:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779494.994073:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779494.994075:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787779494.994099:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f6b6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c28aae66-2825-42c5-8f52-61f687e868c9:3306:1874622524976768:0@lo:103: 00000100:00100000:2.0:1787779494.994219:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779494.994265:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f6b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c28aae66-2825-42c5-8f52-61f687e868c9:3306:1874622524977280:0@lo:103: 00000100:00100000:2.0:1787779494.994285:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779494.994311:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787779494.994317:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f6b5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c28aae66-2825-42c5-8f52-61f687e868c9:3306:1874622524976896:0@lo:103: 00000100:00100000:1.0:1787779494.994761:0:5819:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00000100:00100000:2.0:1787779494.994980:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779494.995014:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f6b5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c28aae66-2825-42c5-8f52-61f687e868c9:3306:1874622524977408:0@lo:103: 00000100:00100000:2.0:1787779494.995042:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779494.995064:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f6b7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c28aae66-2825-42c5-8f52-61f687e868c9:3304:1874622524977024:0@lo:103: 00000100:00100000:2.0:1787779494.995086:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779494.995096:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f6b61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c28aae66-2825-42c5-8f52-61f687e868c9:3304:1874622524977536:0@lo:103: 00000100:00100000:2.0:1787779494.995212:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779494.995227:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787779494.995233:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f6b4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c28aae66-2825-42c5-8f52-61f687e868c9:3304:1874622524977152:0@lo:103: 00000100:00100000:2.0:1787779494.995252:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779494.995277:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524976768 00000100:00100000:2.0:1787779494.995284:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524976768 00010000:00010000:2.0:1787779494.995315:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98e841648e00/0x9e63ba8af6888f1a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9e63ba8af6888f0c expref: 19 pid: 5830 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779494.995333:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524977280 00000100:00100000:2.0:1787779494.995444:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524977280 00010000:00010000:2.0:1787779494.995460:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98e8429d5800/0x9e63ba8af6888eb8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9e63ba8af6888eb1 expref: 20 pid: 5831 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779494.995473:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524976896 00000100:00100000:2.0:1787779494.995475:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524976896 00010000:00010000:2.0:1787779494.995484:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98e882048a00/0x9e63ba8af6888ef0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9e63ba8af6888ee9 expref: 21 pid: 5828 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779494.995494:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524977408 00000100:00100000:2.0:1787779494.995496:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524977408 00010000:00010000:2.0:1787779494.995505:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98e848f69800/0x9e63ba8af6888e8e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9e63ba8af6888e87 expref: 22 pid: 5831 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779494.995514:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524977024 00000100:00100000:2.0:1787779494.995516:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524977024 00010000:00010000:2.0:1787779494.995526:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98e848f68e00/0x9e63ba8af6888ed4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9e63ba8af6888ecd expref: 23 pid: 5830 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779494.995534:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524977536 00000100:00100000:2.0:1787779494.995535:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524977536 00010000:00010000:2.0:1787779494.995543:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98e848f68c00/0x9e63ba8af6888e64 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9e63ba8af6888e5d expref: 24 pid: 5830 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779494.995857:0:8438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e842fee1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8438:1874622524975872:0@lo:104: 00000100:00100000:0.0:1787779494.995891:0:8438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e842fecf00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8438:1874622524976000:0@lo:104: 00000100:00100000:0.0:1787779494.995899:0:8438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e842fed680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8438:1874622524976128:0@lo:104: 00000100:00100000:0.0:1787779494.995906:0:8438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e842fed2c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8438:1874622524976256:0@lo:104: 00000100:00100000:0.0:1787779494.995913:0:8438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e842fee940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8438:1874622524976384:0@lo:104: 00000100:00100000:0.0:1787779494.995920:0:8438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e842fef840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8438:1874622524976512:0@lo:104: 00000100:00100000:0.0:1787779494.995929:0:8438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e842fef0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8438:1874622524976640:0@lo:104: 00000100:00100000:2.0:1787779494.996007:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524977152 00000100:00100000:2.0:1787779494.996011:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524977152 00010000:00010000:2.0:1787779494.996025:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98e8429d5c00/0x9e63ba8af6888ec6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9e63ba8af6888ebf expref: 25 pid: 5830 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779494.996037:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787779494.996044:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f6b43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c28aae66-2825-42c5-8f52-61f687e868c9+25:3306:x1874622524976768:12345-0@lo:103: 00010000:00010000:2.0:1787779494.996056:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787779494.996061:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98e841648e00/0x9e63ba8af6888f1a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9e63ba8af6888f0c expref: 25 pid: 5830 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779494.996071:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98e841648e00/0x9e63ba8af6888f1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9e63ba8af6888f0c expref: 25 pid: 5830 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779494.996086:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e841648e00/0x9e63ba8af6888f1a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9e63ba8af6888f0c expref: 25 pid: 5830 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779494.996099:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787779494.996222:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f6b43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c28aae66-2825-42c5-8f52-61f687e868c9+24:3306:x1874622524976768:12345-0@lo:103: Request processed in 178us (2003us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779494.996230:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787779494.996246:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787779494.996252:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f6b4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c28aae66-2825-42c5-8f52-61f687e868c9+23:3306:x1874622524977280:12345-0@lo:103: 00010000:00010000:2.0:1787779494.996260:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787779494.996264:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98e8429d5800/0x9e63ba8af6888eb8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9e63ba8af6888eb1 expref: 23 pid: 5831 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779494.996272:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98e8429d5800/0x9e63ba8af6888eb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9e63ba8af6888eb1 expref: 23 pid: 5831 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779494.996289:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e8429d5800/0x9e63ba8af6888eb8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9e63ba8af6888eb1 expref: 23 pid: 5831 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779494.996298:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787779494.996319:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f6b4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c28aae66-2825-42c5-8f52-61f687e868c9+22:3306:x1874622524977280:12345-0@lo:103: Request processed in 68us (2034us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779494.996325:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787779494.998245:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787779494.998270:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f6b5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c28aae66-2825-42c5-8f52-61f687e868c9+21:3306:x1874622524976896:12345-0@lo:103: 00010000:00010000:2.0:1787779494.998291:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787779494.998300:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98e882048a00/0x9e63ba8af6888ef0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9e63ba8af6888ee9 expref: 21 pid: 5828 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779494.998313:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98e882048a00/0x9e63ba8af6888ef0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9e63ba8af6888ee9 expref: 21 pid: 5828 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779494.998333:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e882048a00/0x9e63ba8af6888ef0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9e63ba8af6888ee9 expref: 21 pid: 5828 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779494.998792:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787779494.998862:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f6b5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c28aae66-2825-42c5-8f52-61f687e868c9+20:3306:x1874622524976896:12345-0@lo:103: Request processed in 603us (3880us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779494.998870:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787779494.998902:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787779494.998910:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f6b52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c28aae66-2825-42c5-8f52-61f687e868c9+19:3306:x1874622524977408:12345-0@lo:103: 00010000:00010000:2.0:1787779494.998923:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787779494.998928:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98e848f69800/0x9e63ba8af6888e8e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9e63ba8af6888e87 expref: 19 pid: 5831 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779494.998950:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98e848f69800/0x9e63ba8af6888e8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9e63ba8af6888e87 expref: 19 pid: 5831 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779494.998963:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e848f69800/0x9e63ba8af6888e8e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9e63ba8af6888e87 expref: 19 pid: 5831 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779494.998973:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787779494.998997:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f6b52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c28aae66-2825-42c5-8f52-61f687e868c9+18:3306:x1874622524977408:12345-0@lo:103: Request processed in 90us (3955us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779494.999003:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787779494.999017:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787779494.999024:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f6b7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c28aae66-2825-42c5-8f52-61f687e868c9+17:3304:x1874622524977024:12345-0@lo:103: 00010000:00010000:2.0:1787779494.999033:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787779494.999037:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98e848f68e00/0x9e63ba8af6888ed4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9e63ba8af6888ecd expref: 17 pid: 5830 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779494.999045:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98e848f68e00/0x9e63ba8af6888ed4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9e63ba8af6888ecd expref: 17 pid: 5830 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779494.999055:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e848f68e00/0x9e63ba8af6888ed4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9e63ba8af6888ecd expref: 17 pid: 5830 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779494.999063:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787779494.999238:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f6b7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c28aae66-2825-42c5-8f52-61f687e868c9+16:3304:x1874622524977024:12345-0@lo:103: Request processed in 214us (4150us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779494.999244:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787779494.999258:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787779494.999266:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f6b70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c28aae66-2825-42c5-8f52-61f687e868c9+15:3304:x1874622524977536:12345-0@lo:103: 00010000:00010000:2.0:1787779494.999280:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787779494.999285:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98e848f68c00/0x9e63ba8af6888e64 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9e63ba8af6888e5d expref: 15 pid: 5830 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779494.999293:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98e848f68c00/0x9e63ba8af6888e64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9e63ba8af6888e5d expref: 15 pid: 5830 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779494.999303:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e848f68c00/0x9e63ba8af6888e64 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9e63ba8af6888e5d expref: 15 pid: 5830 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779494.999311:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787779494.999349:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f6b70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c28aae66-2825-42c5-8f52-61f687e868c9+14:3304:x1874622524977536:12345-0@lo:103: Request processed in 70us (4122us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779494.999355:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787779494.999370:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787779494.999376:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e847d95c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c28aae66-2825-42c5-8f52-61f687e868c9+13:3304:x1874622524977152:12345-0@lo:103: 00010000:00010000:2.0:1787779494.999383:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787779494.999388:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98e8429d5c00/0x9e63ba8af6888ec6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9e63ba8af6888ebf expref: 13 pid: 5830 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779494.999395:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98e8429d5c00/0x9e63ba8af6888ec6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9e63ba8af6888ebf expref: 13 pid: 5830 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779494.999406:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e8429d5c00/0x9e63ba8af6888ec6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9e63ba8af6888ebf expref: 13 pid: 5830 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779494.999415:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787779494.999438:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e847d95c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c28aae66-2825-42c5-8f52-61f687e868c9+12:3304:x1874622524977152:12345-0@lo:103: Request processed in 62us (4185us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779494.999453:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1787779494.999531:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779495.000520:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f6b5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c28aae66-2825-42c5-8f52-61f687e868c9:3306:1874622524976896:0@lo:103: 00000100:00100000:0.0:1787779495.000534:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f6b5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c28aae66-2825-42c5-8f52-61f687e868c9:3306:1874622524977408:0@lo:103: 00000100:00100000:0.0:1787779495.000544:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f6b6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c28aae66-2825-42c5-8f52-61f687e868c9:3306:1874622524976768:0@lo:103: 00000100:00100000:0.0:1787779495.000552:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f6b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c28aae66-2825-42c5-8f52-61f687e868c9:3306:1874622524977280:0@lo:103: 00000100:00100000:2.0:1787779495.001741:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779495.001768:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779495.001791:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505029760 00000100:00100000:2.0:1787779495.001799:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505029760 00010000:00010000:2.0:1787779495.001838:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98e8429d4000/0x9e63ba8af6888f28 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedab06 expref: 10 pid: 5830 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779495.001866:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505029632 00000100:00100000:2.0:1787779495.001868:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505029632 00010000:00010000:2.0:1787779495.001878:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98e8429d4a00/0x9e63ba8af6888f2f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedab0d expref: 11 pid: 5828 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779495.001892:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 19 00000100:00100000:2.0:1787779495.001899:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f6b43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+11:2360:x1874622505029760:12345-192.168.201.9@tcp:103: 00010000:00010000:2.0:1787779495.001910:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787779495.001916:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98e8429d4000/0x9e63ba8af6888f28 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedab06 expref: 11 pid: 5830 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779495.001925:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98e8429d4000/0x9e63ba8af6888f28 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedab06 expref: 11 pid: 5830 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779495.001942:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787779495.001984:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f6b43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+11:2360:x1874622505029760:12345-192.168.201.9@tcp:103: Request processed in 86us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779495.001992:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 19 00000100:00100000:2.0:1787779495.002006:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 20 00000100:00100000:2.0:1787779495.002012:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f6b4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+10:2360:x1874622505029632:12345-192.168.201.9@tcp:103: 00010000:00010000:2.0:1787779495.002024:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787779495.002028:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98e8429d4a00/0x9e63ba8af6888f2f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedab0d expref: 10 pid: 5828 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779495.002037:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98e8429d4a00/0x9e63ba8af6888f2f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedab0d expref: 10 pid: 5828 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779495.002049:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98e848f68a00/0x9e63ba8af6888f67 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779495.002058:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e848f68a00/0x9e63ba8af6888f67 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779495.002074:0:5821:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98e848f68a00/0x9e63ba8af6888f67 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779495.002081:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98e848f68a00/0x9e63ba8af6888f67 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779495.002088:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98e848f68a00/0x9e63ba8af6888f67 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779495.002094:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98e848f68a00/0x9e63ba8af6888f67 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779495.002100:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e848f68a00 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:2.0:1787779495.002103:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98e848f68a00/0x9e63ba8af6888f67 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779495.002681:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e8429d4a00/0x9e63ba8af6888f2f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedab0d expref: 10 pid: 5828 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779495.002699:0:8438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e842fef480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8438:1874622524975616:192.168.201.9@tcp:104: 00010000:00010000:0.0:1787779495.002733:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e8429d4000/0x9e63ba8af6888f28 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedab06 expref: 9 pid: 5830 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779495.002741:0:8438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e842feda40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8438:1874622524975744:192.168.201.9@tcp:104: 00010000:00010000:0.0:1787779495.002776:0:8438:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98e848f68a00/0x9e63ba8af6888f67 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779495.002785:0:8438:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGS lock: ffff98e848f68a00/0x9e63ba8af6888f67 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779495.002791:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98e848f68a00/0x9e63ba8af6888f67 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779495.003961:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98e848f68a00/0x9e63ba8af6888f67 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779495.003988:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98e848f68a00/0x9e63ba8af6888f67 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779495.003997:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e848f68a00/0x9e63ba8af6888f67 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779495.004019:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787779495.004069:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f6b4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+8:2360:x1874622505029632:12345-192.168.201.9@tcp:103: Request processed in 2054us (2298us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779495.004078:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 20 00000100:00100000:1.0:1787779495.004586:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f6b7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c28aae66-2825-42c5-8f52-61f687e868c9:3304:1874622524977024:0@lo:103: 00000100:00100000:2.0:1787779495.005750:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f6b61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c28aae66-2825-42c5-8f52-61f687e868c9:3304:1874622524977536:0@lo:103: 00000100:00100000:2.0:1787779495.005782:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f6b4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c28aae66-2825-42c5-8f52-61f687e868c9:3304:1874622524977152:0@lo:103: 00000100:00100000:3.0:1787779495.074034:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779495.074080:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779495.074103:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779495.074152:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505030144 00000100:00100000:3.0:1787779495.074162:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505030144 00000100:00100000:3.0:1787779495.074223:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505030016 00000100:00100000:3.0:1787779495.074226:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505030016 00000100:00100000:3.0:1787779495.074245:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 14 00000100:00100000:3.0:1787779495.074257:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e855b003c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+5:2359:x1874622505030144:12345-192.168.201.9@tcp:400: 00000100:00100000:3.0:1787779495.074356:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e855b003c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+5:2359:x1874622505030144:12345-192.168.201.9@tcp:400: Request processed in 102us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779495.074363:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 14 00000100:00100000:3.0:1787779495.074380:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 15 00000100:00100000:3.0:1787779495.074386:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e855b03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+5:2359:x1874622505030016:12345-192.168.201.9@tcp:400: 00000100:00100000:3.0:1787779495.074407:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e855b03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+5:2359:x1874622505030016:12345-192.168.201.9@tcp:400: Request processed in 23us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779495.074413:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 15 00000100:00080000:3.0:1787779495.074430:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787779495.074444:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787779495.075023:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505029888 00000100:00100000:0.0:1787779495.075029:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505029888 00000100:00100000:0.0:1787779495.075075:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 29 00000100:00100000:0.0:1787779495.075083:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e855b02d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:2359:x1874622505029888:12345-192.168.201.9@tcp:400: 00000100:00100000:0.0:1787779495.075142:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e855b02d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:2359:x1874622505029888:12345-192.168.201.9@tcp:400: Request processed in 60us (1116us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779495.075148:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 29 00000100:00080000:0.0:1787779495.075165:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787779495.542152:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787779496.434848:0:5833:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787779496.434856:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98e87a56c800 from 39 10000000:01000000:2.0:1787779496.434862:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787779496.434911:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e841648a00/0x9e63ba8af6888f6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779496.434923:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff98e841648a00/0x9e63ba8af6888f6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779496.434934:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff98e841648a00/0x9e63ba8af6888f6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779496.434959:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f6b4b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524977664:0@lo:101: 00000100:00100000:2.0:1787779496.435031:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779496.435118:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e87ec74180 going to sleep for 11 seconds 00000100:00100000:0.0:1787779496.435223:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524977664 00000100:00100000:0.0:1787779496.435230:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524977664 00000100:00100000:0.0:1787779496.435292:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787779496.435306:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842efdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+12:5833:x1874622524977664:12345-0@lo:101: 00010000:00010000:0.0:1787779496.435319:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787779496.435331:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e848f69000/0x9e63ba8af6888f75 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9e63ba8af6888f6e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779496.435352:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e848f69000/0x9e63ba8af6888f75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9e63ba8af6888f6e expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779496.435362:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e848f69000/0x9e63ba8af6888f75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af6888f6e expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779496.435371:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e848f69000, rc 0) 00000100:00100000:0.0:1787779496.435412:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842efdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+13:5833:x1874622524977664:12345-0@lo:101: Request processed in 108us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779496.435418:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1787779496.435530:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f6b4b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524977664:0@lo:101: 00010000:00010000:2.0:1787779496.435545:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff98e841648a00/0x9e63ba8af6888f6e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888f75 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779496.435554:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff98e841648a00/0x9e63ba8af6888f6e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9e63ba8af6888f75 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779496.435610:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f6b4b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524977792:0@lo:501: 00000100:00100000:2.0:1787779496.435634:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779496.435656:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e87ec74180 going to sleep for 11 seconds 00000100:00100000:0.0:1787779496.435706:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524977792 00000100:00100000:0.0:1787779496.435730:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524977792 00000100:00100000:0.0:1787779496.435762:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787779496.435768:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842efc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+13:5833:x1874622524977792:12345-0@lo:501: 00000100:00100000:0.0:1787779496.436028:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842efc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+13:5833:x1874622524977792:12345-0@lo:501: Request processed in 258us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779496.436035:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787779496.436122:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f6b4b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524977792:0@lo:501: 00000100:00100000:1.0:1787779496.436154:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ece6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524977920:0@lo:503: 00000100:00100000:1.0:1787779496.436199:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779496.436232:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e844c19b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787779496.436393:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524977920 00000100:00100000:0.0:1787779496.436398:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524977920 00000100:00100000:0.0:1787779496.436431:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787779496.436439:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842efcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+13:5833:x1874622524977920:12345-0@lo:503: 00000100:00100000:0.0:1787779496.436614:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842efcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+13:5833:x1874622524977920:12345-0@lo:503: Request processed in 176us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779496.436629:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787779496.437673:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ece6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524977920:0@lo:503: 00000100:00100000:3.0:1787779496.438564:0:8455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855b00f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c28aae66-2825-42c5-8f52-61f687e868c9:8455:1874622524978048:0@lo:502: 00000100:00100000:3.0:1787779496.438641:0:8455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779496.438682:0:8455:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e742bd13c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787779496.438739:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524978048 00000100:00100000:2.0:1787779496.438745:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524978048 00000100:00100000:2.0:1787779496.438790:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787779496.438799:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842eff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+13:8455:x1874622524978048:12345-0@lo:502: 00000100:00100000:2.0:1787779496.439025:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842eff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+13:8455:x1874622524978048:12345-0@lo:502: Request processed in 226us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779496.439033:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787779496.439130:0:8455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855b00f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c28aae66-2825-42c5-8f52-61f687e868c9:8455:1874622524978048:0@lo:502: 00000100:00100000:3.0:1787779496.439168:0:8455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855b00f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c28aae66-2825-42c5-8f52-61f687e868c9:8455:1874622524978176:0@lo:502: 00000100:00100000:3.0:1787779496.439196:0:8455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779496.439221:0:8455:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e742bd13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787779496.439270:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524978176 00000100:00100000:0.0:1787779496.439274:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524978176 00000100:00100000:0.0:1787779496.439300:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787779496.439307:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842eff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+13:8455:x1874622524978176:12345-0@lo:502: 00000100:00100000:0.0:1787779496.439429:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842eff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+13:8455:x1874622524978176:12345-0@lo:502: Request processed in 122us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779496.439435:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787779496.439506:0:8455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855b00f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c28aae66-2825-42c5-8f52-61f687e868c9:8455:1874622524978176:0@lo:502: 00000040:00080000:3.0:1787779496.439524:0:8455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1787779496.439697:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1787779496.439753:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787779496.439764:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e841648a00/0x9e63ba8af6888f6e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888f75 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779496.439773:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff98e841648a00/0x9e63ba8af6888f6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888f75 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787779496.439783:0:5833:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1787779496.439786:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1787779496.439788:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1787779496.439813:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e848f69400/0x9e63ba8af6888f7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779496.439821:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff98e848f69400/0x9e63ba8af6888f7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779496.439829:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff98e848f69400/0x9e63ba8af6888f7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779496.439841:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e842feda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524978304:0@lo:101: 00000100:00100000:0.0:1787779496.439875:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779496.439903:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e845ef5c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787779496.439986:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524978304 00000100:00100000:1.0:1787779496.439992:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524978304 00000100:00100000:1.0:1787779496.440024:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787779496.440031:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842efe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+13:5833:x1874622524978304:12345-0@lo:101: 00010000:00010000:1.0:1787779496.440040:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779496.440052:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e87a98b400/0x9e63ba8af6888f83 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9e63ba8af6888f7c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779496.440083:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e87a98b400/0x9e63ba8af6888f83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9e63ba8af6888f7c expref: 14 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779496.440093:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e87a98b400/0x9e63ba8af6888f83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af6888f7c expref: 14 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779496.440101:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87a98b400, rc 0) 00000100:00100000:1.0:1787779496.440150:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842efe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+14:5833:x1874622524978304:12345-0@lo:101: Request processed in 120us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779496.440163:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787779496.440197:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e842feda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524978304:0@lo:101: 00010000:00010000:2.0:1787779496.440210:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff98e848f69400/0x9e63ba8af6888f7c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888f83 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779496.440218:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff98e848f69400/0x9e63ba8af6888f7c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9e63ba8af6888f83 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779496.440263:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f6b61c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524978432:0@lo:501: 00000100:00100000:2.0:1787779496.440298:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779496.440328:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e87ec74300 going to sleep for 11 seconds 00000100:00100000:3.0:1787779496.440380:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524978432 00000100:00100000:3.0:1787779496.440384:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524978432 00000100:00100000:3.0:1787779496.440408:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1787779496.440414:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842efd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+14:5833:x1874622524978432:12345-0@lo:501: 00000100:00100000:3.0:1787779496.440635:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842efd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+14:5833:x1874622524978432:12345-0@lo:501: Request processed in 220us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779496.440642:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787779496.441049:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f6b61c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524978432:0@lo:501: 00000100:00100000:2.0:1787779496.441077:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f6b61c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524978560:0@lo:503: 00000100:00100000:2.0:1787779496.441125:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779496.441151:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e87ec74300 going to sleep for 11 seconds 00000100:00100000:1.0:1787779496.441565:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524978560 00000100:00100000:1.0:1787779496.441571:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524978560 00000100:00100000:1.0:1787779496.441615:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787779496.441623:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842efe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+14:5833:x1874622524978560:12345-0@lo:503: 00000100:00100000:0.0:1787779496.441937:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842efe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+14:5833:x1874622524978560:12345-0@lo:503: Request processed in 313us (810us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779496.441945:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787779496.442033:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f6b61c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524978560:0@lo:503: 00000100:00100000:3.0:1787779496.451472:0:8456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855b00f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c28aae66-2825-42c5-8f52-61f687e868c9:8456:1874622524978688:0@lo:502: 00000100:00100000:3.0:1787779496.451570:0:8456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779496.451616:0:8456:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e742bd1b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787779496.451704:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524978688 00000100:00100000:1.0:1787779496.451840:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524978688 00000100:00100000:2.0:1787779496.451966:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787779496.451976:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842efd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+14:8456:x1874622524978688:12345-0@lo:502: 00000100:00100000:2.0:1787779496.452374:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842efd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+14:8456:x1874622524978688:12345-0@lo:502: Request processed in 399us (803us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779496.452383:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787779496.453261:0:8456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855b00f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c28aae66-2825-42c5-8f52-61f687e868c9:8456:1874622524978688:0@lo:502: 00000020:01000000:3.0:1787779496.453297:0:8456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787779496.453307:0:8456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787779496.453310:0:8456:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787779496.453317:0:8456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787779496.453343:0:8456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855b00f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c28aae66-2825-42c5-8f52-61f687e868c9:8456:1874622524978816:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787779496.453392:0:8456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779496.453434:0:8456:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e742bd1b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787779496.453491:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524978816 00000100:00100000:2.0:1787779496.453496:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524978816 00000100:00100000:2.0:1787779496.453577:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787779496.453586:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842efc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+14:8456:x1874622524978816:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787779496.453778:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842efc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+14:8456:x1874622524978816:12345-0@lo:502:llog_process_th.0 Request processed in 192us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779496.453785:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787779496.453868:0:8456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855b00f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c28aae66-2825-42c5-8f52-61f687e868c9:8456:1874622524978816:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787779496.453885:0:8456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787779496.453889:0:8456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787779496.453891:0:8456:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787779496.453895:0:8456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1787779496.454023:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1787779496.454042:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787779496.454051:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e848f69400/0x9e63ba8af6888f7c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888f83 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779496.454063:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff98e848f69400/0x9e63ba8af6888f7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888f83 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787779496.454071:0:5833:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787779496.454074:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98e848ee5800 from 39 10000000:01000000:3.0:1787779496.454077:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787779496.454114:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e882048a00/0x9e63ba8af6888f8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779496.454121:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff98e882048a00/0x9e63ba8af6888f8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779496.454130:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff98e882048a00/0x9e63ba8af6888f8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779496.454144:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855b00f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524978944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787779496.454173:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779496.458535:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e742bd1b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787779496.459208:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524978944 00000100:00100000:0.0:1787779496.459218:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524978944 00000100:00100000:0.0:1787779496.459273:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787779496.459282:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842eff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+14:5833:x1874622524978944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787779496.459298:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787779496.459317:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e848f69a00/0x9e63ba8af6888f91 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9e63ba8af6888f8a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779496.459348:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e848f69a00/0x9e63ba8af6888f91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9e63ba8af6888f8a expref: 15 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779496.459359:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e848f69a00/0x9e63ba8af6888f91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af6888f8a expref: 15 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779496.459368:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e848f69a00, rc 0) 00000100:00100000:0.0:1787779496.459434:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842eff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+15:5833:x1874622524978944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (5260us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779496.459441:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787779496.459553:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855b00f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524978944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787779496.459571:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff98e882048a00/0x9e63ba8af6888f8a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888f91 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779496.459580:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff98e882048a00/0x9e63ba8af6888f8a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9e63ba8af6888f91 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779496.459663:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ece6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524979072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787779496.459707:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779496.459748:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e844c19f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787779496.459799:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524979072 00000100:00100000:0.0:1787779496.459803:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524979072 00000100:00100000:0.0:1787779496.459820:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787779496.459827:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842efe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+15:5833:x1874622524979072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787779496.460158:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842efe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+15:5833:x1874622524979072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 331us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779496.460173:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787779496.460581:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ece6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524979072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787779496.460666:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ece6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524979200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787779496.460777:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779496.460846:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e844c19f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787779496.460901:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524979200 00000100:00100000:3.0:1787779496.460906:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524979200 00000100:00100000:0.0:1787779496.461014:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787779496.461023:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842efec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+15:5833:x1874622524979200:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787779496.461291:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842efec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+15:5833:x1874622524979200:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 268us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779496.461299:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787779496.461430:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ece6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524979200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787779496.462088:0:8457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ece6d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c28aae66-2825-42c5-8f52-61f687e868c9:8457:1874622524979328:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787779496.462151:0:8457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779496.462193:0:8457:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e844c19540 going to sleep for 11 seconds 00000100:00100000:0.0:1787779496.462291:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524979328 00000100:00100000:0.0:1787779496.462296:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524979328 00000100:00100000:0.0:1787779496.462332:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787779496.462339:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842efc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+15:8457:x1874622524979328:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787779496.462535:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842efc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+15:8457:x1874622524979328:12345-0@lo:502:llog_process_th.0 Request processed in 196us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779496.462542:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787779496.462760:0:8457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ece6d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c28aae66-2825-42c5-8f52-61f687e868c9:8457:1874622524979328:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787779496.462802:0:8457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ece6d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c28aae66-2825-42c5-8f52-61f687e868c9:8457:1874622524979456:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787779496.462835:0:8457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779496.462859:0:8457:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e844c19540 going to sleep for 11 seconds 00000100:00100000:2.0:1787779496.463018:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524979456 00000100:00100000:2.0:1787779496.463023:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524979456 00000100:00100000:2.0:1787779496.463060:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787779496.463067:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842efd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+15:8457:x1874622524979456:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787779496.463223:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842efd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+15:8457:x1874622524979456:12345-0@lo:502:llog_process_th.0 Request processed in 156us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779496.463230:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787779496.463440:0:8457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ece6d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c28aae66-2825-42c5-8f52-61f687e868c9:8457:1874622524979456:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787779496.463461:0:8457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1787779496.463621:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1787779496.463642:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787779496.463653:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e882048a00/0x9e63ba8af6888f8a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888f91 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779496.463664:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff98e882048a00/0x9e63ba8af6888f8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888f91 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787779496.463674:0:5833:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1787779496.463677:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1787779496.463680:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787779496.463746:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e848f68600/0x9e63ba8af6888f98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779496.463764:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff98e848f68600/0x9e63ba8af6888f98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779496.463774:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff98e848f68600/0x9e63ba8af6888f98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779496.463788:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e842fef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524979584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787779496.463820:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779496.463850:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e87f036d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787779496.464144:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524979584 00000100:00100000:2.0:1787779496.464150:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524979584 00000100:00100000:2.0:1787779496.464175:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787779496.464182:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ef8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+15:5833:x1874622524979584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787779496.464192:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779496.464203:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e841649a00/0x9e63ba8af6888f9f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9e63ba8af6888f98 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779496.464224:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e841649a00/0x9e63ba8af6888f9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9e63ba8af6888f98 expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779496.464234:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e841649a00/0x9e63ba8af6888f9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af6888f98 expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779496.464242:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e841649a00, rc 0) 00000100:00100000:2.0:1787779496.464283:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ef8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+16:5833:x1874622524979584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779496.464289:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787779496.464443:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e842fef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524979584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787779496.464457:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff98e848f68600/0x9e63ba8af6888f98 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888f9f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779496.464465:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff98e848f68600/0x9e63ba8af6888f98 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9e63ba8af6888f9f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779496.464511:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e842fef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524979712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787779496.464538:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779496.464565:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e87f036d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787779496.464628:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524979712 00000100:00100000:2.0:1787779496.464632:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524979712 00000100:00100000:2.0:1787779496.464660:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787779496.464667:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ef9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+16:5833:x1874622524979712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787779496.465007:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ef9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+16:5833:x1874622524979712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 340us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779496.465015:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1787779496.465329:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e842fef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524979712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787779496.465361:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e842fef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524979840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787779496.465401:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779496.465431:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e87f036d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787779496.465490:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524979840 00000100:00100000:2.0:1787779496.465496:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524979840 00000100:00100000:2.0:1787779496.465529:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787779496.465536:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ef8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+16:5833:x1874622524979840:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787779496.466002:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ef8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+16:5833:x1874622524979840:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 465us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779496.466009:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787779496.466214:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e842fef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524979840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787779496.466516:0:8458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f6b61c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c28aae66-2825-42c5-8f52-61f687e868c9:8458:1874622524979968:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787779496.466556:0:8458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779496.466625:0:8458:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e87ec749c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787779496.466979:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524979968 00000100:00100000:1.0:1787779496.466985:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524979968 00000100:00100000:1.0:1787779496.467027:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787779496.467036:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842efb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+16:8458:x1874622524979968:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787779496.467322:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842efb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+16:8458:x1874622524979968:12345-0@lo:502:llog_process_th.0 Request processed in 288us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779496.467330:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787779496.467398:0:8458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f6b61c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c28aae66-2825-42c5-8f52-61f687e868c9:8458:1874622524979968:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787779496.467422:0:8458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787779496.467432:0:8458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787779496.467434:0:8458:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787779496.467443:0:8458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787779496.467464:0:8458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f6b61c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c28aae66-2825-42c5-8f52-61f687e868c9:8458:1874622524980096:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787779496.467499:0:8458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779496.467527:0:8458:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e87ec749c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787779496.467566:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524980096 00000100:00100000:3.0:1787779496.467571:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524980096 00000100:00100000:3.0:1787779496.467606:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787779496.467615:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842efb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+16:8458:x1874622524980096:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787779496.467774:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842efb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+16:8458:x1874622524980096:12345-0@lo:502:llog_process_th.0 Request processed in 161us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779496.467781:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787779496.468172:0:8458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f6b61c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c28aae66-2825-42c5-8f52-61f687e868c9:8458:1874622524980096:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787779496.468193:0:8458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787779496.468199:0:8458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787779496.468201:0:8458:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787779496.468205:0:8458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:2.0:1787779496.468368:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1787779496.468385:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787779496.468395:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e848f68600/0x9e63ba8af6888f98 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888f9f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779496.468405:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff98e848f68600/0x9e63ba8af6888f98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888f9f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787779496.468414:0:5833:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787779496.468416:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98e846b05800 from 39 10000000:01000000:2.0:1787779496.468419:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787779496.468442:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e841649000/0x9e63ba8af6888fa6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779496.468460:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff98e841649000/0x9e63ba8af6888fa6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779496.468469:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff98e841649000/0x9e63ba8af6888fa6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779496.468482:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f6b7c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524980224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787779496.468518:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779496.468548:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e87ec74c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787779496.468593:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524980224 00000100:00100000:1.0:1787779496.468597:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524980224 00000100:00100000:1.0:1787779496.468698:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787779496.468705:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842efa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+16:5833:x1874622524980224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787779496.468732:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779496.468744:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e87a98ba00/0x9e63ba8af6888fad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9e63ba8af6888fa6 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779496.468775:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e87a98ba00/0x9e63ba8af6888fad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9e63ba8af6888fa6 expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779496.468784:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e87a98ba00/0x9e63ba8af6888fad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af6888fa6 expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779496.468793:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87a98ba00, rc 0) 00000100:00100000:1.0:1787779496.468826:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842efa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+17:5833:x1874622524980224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779496.468831:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787779496.468983:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f6b7c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524980224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787779496.468995:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff98e841649000/0x9e63ba8af6888fa6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888fad expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779496.469003:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff98e841649000/0x9e63ba8af6888fa6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9e63ba8af6888fad expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779496.469043:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f6b7c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524980352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787779496.469196:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779496.469253:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e87ec74c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787779496.469347:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524980352 00000100:00100000:3.0:1787779496.469352:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524980352 00000100:00100000:3.0:1787779496.469382:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787779496.469388:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ef9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+17:5833:x1874622524980352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787779496.470200:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ef9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+17:5833:x1874622524980352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 809us (1001us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779496.470210:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787779496.470275:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f6b7c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524980352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787779496.470321:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e842fef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524980480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787779496.470362:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779496.470423:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e87f036d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787779496.470466:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524980480 00000100:00100000:3.0:1787779496.470471:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524980480 00000100:00100000:3.0:1787779496.470531:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787779496.470538:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842efa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+17:5833:x1874622524980480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787779496.470708:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842efa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+17:5833:x1874622524980480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 169us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779496.470737:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787779496.470805:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e842fef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524980480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787779496.471404:0:8459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e842fef480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c28aae66-2825-42c5-8f52-61f687e868c9:8459:1874622524980608:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787779496.471447:0:8459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779496.471557:0:8459:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e87f036a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787779496.471684:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524980608 00000100:00100000:1.0:1787779496.471697:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524980608 00000100:00100000:1.0:1787779496.471737:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787779496.471746:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ef9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+17:8459:x1874622524980608:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787779496.472201:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ef9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+17:8459:x1874622524980608:12345-0@lo:502:llog_process_th.0 Request processed in 455us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779496.472208:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787779496.472364:0:8459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e842fef480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c28aae66-2825-42c5-8f52-61f687e868c9:8459:1874622524980608:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787779496.472404:0:8459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e842fef480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c28aae66-2825-42c5-8f52-61f687e868c9:8459:1874622524980736:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787779496.472437:0:8459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779496.472493:0:8459:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e87f036a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787779496.472521:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524980736 00000100:00100000:1.0:1787779496.472525:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524980736 00000100:00100000:1.0:1787779496.472575:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787779496.472582:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ef8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+17:8459:x1874622524980736:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787779496.473030:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ef8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+17:8459:x1874622524980736:12345-0@lo:502:llog_process_th.0 Request processed in 448us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779496.473037:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787779496.473290:0:8459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e842fef480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c28aae66-2825-42c5-8f52-61f687e868c9:8459:1874622524980736:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787779496.473312:0:8459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1787779496.473542:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1787779496.473564:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787779496.473575:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e841649000/0x9e63ba8af6888fa6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888fad expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779496.473596:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff98e841649000/0x9e63ba8af6888fa6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888fad expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787779496.473675:0:5833:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787779496.473678:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1787779496.473681:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787779496.474041:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e841648e00/0x9e63ba8af6888fb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779496.474365:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff98e841648e00/0x9e63ba8af6888fb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779496.474377:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff98e841648e00/0x9e63ba8af6888fb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779496.474396:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f6b5680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524980864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787779496.474440:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779496.474510:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e87ec74000 going to sleep for 11 seconds 00000100:00100000:3.0:1787779496.474580:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524980864 00000100:00100000:3.0:1787779496.474585:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524980864 00000100:00100000:3.0:1787779496.475054:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787779496.475075:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842efb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+17:5833:x1874622524980864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787779496.475087:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779496.475112:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e882049400/0x9e63ba8af6888fbb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9e63ba8af6888fb4 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779496.475149:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e882049400/0x9e63ba8af6888fbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9e63ba8af6888fb4 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779496.475159:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e882049400/0x9e63ba8af6888fbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af6888fb4 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779496.475168:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e882049400, rc 0) 00000100:00100000:3.0:1787779496.475216:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842efb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+18:5833:x1874622524980864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779496.475223:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787779496.475337:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f6b5680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524980864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787779496.475353:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff98e841648e00/0x9e63ba8af6888fb4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888fbb expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779496.475362:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff98e841648e00/0x9e63ba8af6888fb4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9e63ba8af6888fbb expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779496.475411:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e842fef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524980992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787779496.475439:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779496.475630:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e87f036a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787779496.475842:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524980992 00000100:00100000:2.0:1787779496.475848:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524980992 00000100:00100000:2.0:1787779496.475875:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787779496.475882:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842efa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+18:5833:x1874622524980992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787779496.476255:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842efa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+18:5833:x1874622524980992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 372us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779496.476263:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787779496.476377:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e842fef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524980992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787779496.476418:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e842fef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524981120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787779496.476456:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779496.476475:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e87f036a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787779496.476526:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524981120 00000100:00100000:2.0:1787779496.476530:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524981120 00000100:00100000:2.0:1787779496.476549:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787779496.476563:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842efac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+18:5833:x1874622524981120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787779496.476996:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842efac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+18:5833:x1874622524981120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 433us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779496.477003:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787779496.477273:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e842fef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524981120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787779496.477676:0:8460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855b00f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c28aae66-2825-42c5-8f52-61f687e868c9:8460:1874622524981248:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787779496.478001:0:8460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779496.478079:0:8460:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e742bd1d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787779496.478198:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524981248 00000100:00100000:2.0:1787779496.478203:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524981248 00000100:00100000:2.0:1787779496.478266:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787779496.478275:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ef8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+18:8460:x1874622524981248:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787779496.478495:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ef8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+18:8460:x1874622524981248:12345-0@lo:502:llog_process_th.0 Request processed in 221us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779496.478502:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787779496.478568:0:8460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855b00f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c28aae66-2825-42c5-8f52-61f687e868c9:8460:1874622524981248:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787779496.478595:0:8460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787779496.478614:0:8460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787779496.478617:0:8460:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787779496.478623:0:8460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787779496.478644:0:8460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e842fef480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c28aae66-2825-42c5-8f52-61f687e868c9:8460:1874622524981376:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787779496.478676:0:8460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779496.479583:0:8460:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e87f036a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787779496.479671:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524981376 00000100:00100000:3.0:1787779496.479677:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524981376 00000100:00100000:3.0:1787779496.479729:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787779496.479738:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ef9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+18:8460:x1874622524981376:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787779496.479948:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ef9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+18:8460:x1874622524981376:12345-0@lo:502:llog_process_th.0 Request processed in 211us (1270us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779496.479955:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787779496.480281:0:8460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e842fef480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c28aae66-2825-42c5-8f52-61f687e868c9:8460:1874622524981376:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787779496.480308:0:8460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787779496.480314:0:8460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787779496.480316:0:8460:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787779496.480321:0:8460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1787779496.480471:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:1.0:1787779496.480494:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787779496.480510:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e841648e00/0x9e63ba8af6888fb4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888fbb expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779496.480521:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff98e841648e00/0x9e63ba8af6888fb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888fbb expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787779496.480531:0:5833:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1787779496.480533:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff98e842f18000 from 1 10000000:01000000:1.0:1787779496.480537:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787779496.480564:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e87a98b000/0x9e63ba8af6888fc2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779496.480573:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff98e87a98b000/0x9e63ba8af6888fc2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779496.480581:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff98e87a98b000/0x9e63ba8af6888fc2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779496.480597:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ece6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524981504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787779496.480646:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779496.480668:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e844c19f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787779496.480881:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524981504 00000100:00100000:3.0:1787779496.480886:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524981504 00000100:00100000:3.0:1787779496.480926:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787779496.480933:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842efbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+18:5833:x1874622524981504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787779496.480942:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779496.480955:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e882049000/0x9e63ba8af6888fc9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x9e63ba8af6888fc2 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779496.480984:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e882049000/0x9e63ba8af6888fc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9e63ba8af6888fc2 expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779496.480995:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e882049000/0x9e63ba8af6888fc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af6888fc2 expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779496.481004:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e882049000, rc 0) 00000100:00100000:3.0:1787779496.481042:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842efbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+19:5833:x1874622524981504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779496.481192:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ece6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524981504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787779496.481206:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff98e87a98b000/0x9e63ba8af6888fc2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888fc9 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779496.481215:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff98e87a98b000/0x9e63ba8af6888fc2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9e63ba8af6888fc9 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779496.481258:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e842fef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524981632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787779496.481296:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779496.481312:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e87f036a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787779496.481354:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524981632 00000100:00100000:1.0:1787779496.481359:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524981632 00000100:00100000:3.0:1787779496.481388:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787779496.481578:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787779496.481587:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ebfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+19:5833:x1874622524981632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787779496.482308:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ebfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+19:5833:x1874622524981632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 720us (1010us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787779496.482318:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787779496.482375:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e842fef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524981632:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1787779496.482406:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787779496.482415:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e87a98b000/0x9e63ba8af6888fc2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888fc9 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779496.482423:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff98e87a98b000/0x9e63ba8af6888fc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888fc9 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779496.563281:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779497.587693:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787779498.419038:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f6b52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874622524981760:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787779498.419141:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779498.419980:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524981760 00000100:00100000:1.0:1787779498.420004:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524981760 00000100:00100000:1.0:1787779498.420095:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1787779498.420100:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787779498.420107:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f6b7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874622524981760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787779498.420146:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787779498.420217:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f6b7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874622524981760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (1075us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779498.420225:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1787779498.420273:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e87f6b52c0 x1874622524981760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779514 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779498.420302:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f6b52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874622524981760:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787779498.611027:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787779499.167536:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779499.167739:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505030272 00000100:00100000:0.0:1787779499.167748:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505030272 00000100:00100000:0.0:1787779499.167800:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 164 00000100:00100000:0.0:1787779499.167809:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ebcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+8:5601:x1874622505030272:12345-192.168.201.9@tcp:101: 00010000:00010000:0.0:1787779499.167823:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787779499.167840:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e848f69c00/0x9e63ba8af6888fd0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedab6f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779499.167869:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e848f69c00/0x9e63ba8af6888fd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedab6f expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779499.167879:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e848f69c00/0x9e63ba8af6888fd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedab6f expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779499.167888:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e848f69c00, rc 0) 00000100:00100000:0.0:1787779499.167948:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ebcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+9:5601:x1874622505030272:12345-192.168.201.9@tcp:101: Request processed in 141us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779499.167954:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 164 00000100:00100000:3.0:1787779499.177916:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779499.178176:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505030400 00000100:00100000:1.0:1787779499.178187:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505030400 00000100:00100000:1.0:1787779499.178256:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 165 00000100:00100000:1.0:1787779499.178266:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ebdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+9:5601:x1874622505030400:12345-192.168.201.9@tcp:501: 00000100:00100000:1.0:1787779499.178595:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ebdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+9:5601:x1874622505030400:12345-192.168.201.9@tcp:501: Request processed in 329us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779499.178604:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 165 00000100:00100000:1.0:1787779499.181814:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779499.183218:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505030528 00000100:00100000:2.0:1787779499.183231:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505030528 00000100:00100000:2.0:1787779499.183299:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 166 00000100:00100000:2.0:1787779499.183308:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ebc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+9:5601:x1874622505030528:12345-192.168.201.9@tcp:503: 00000100:00100000:2.0:1787779499.184694:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ebc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+9:5601:x1874622505030528:12345-192.168.201.9@tcp:503: Request processed in 1379us (2881us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779499.184740:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 166 00000100:00100000:2.0:1787779499.192843:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779499.192926:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505030656 00000100:00100000:0.0:1787779499.192937:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505030656 00000100:00100000:0.0:1787779499.192991:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 167 00000100:00100000:0.0:1787779499.193001:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ebf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+9:6084:x1874622505030656:12345-192.168.201.9@tcp:502: 00000100:00100000:0.0:1787779499.193310:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ebf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+9:6084:x1874622505030656:12345-192.168.201.9@tcp:502: Request processed in 310us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779499.193318:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 167 00000100:00100000:3.0:1787779499.205898:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779499.207260:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505030784 00000100:00100000:2.0:1787779499.207274:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505030784 00000100:00100000:2.0:1787779499.207359:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 168 00000100:00100000:2.0:1787779499.207371:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ebf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+9:6084:x1874622505030784:12345-192.168.201.9@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787779499.207702:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ebf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+9:6084:x1874622505030784:12345-192.168.201.9@tcp:502:llog_process_th.0 Request processed in 332us (1813us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779499.207751:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 168 00000100:00100000:3.0:1787779499.212418:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779499.212791:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505030912 00000100:00100000:1.0:1787779499.212801:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505030912 00000100:00100000:1.0:1787779499.212864:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 169 00000100:00100000:1.0:1787779499.212873:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ebe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+9:5601:x1874622505030912:12345-192.168.201.9@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787779499.212890:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779499.212910:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e87a98a800/0x9e63ba8af6888fd7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedab76 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779499.212939:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e87a98a800/0x9e63ba8af6888fd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedab76 expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779499.212951:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e87a98a800/0x9e63ba8af6888fd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedab76 expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779499.212976:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87a98a800, rc 0) 00000100:00100000:1.0:1787779499.213043:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ebe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+10:5601:x1874622505030912:12345-192.168.201.9@tcp:101:ll_cfg_requeue.0 Request processed in 171us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779499.213051:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 169 00000100:00100000:1.0:1787779499.232920:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779499.233116:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505031040 00000100:00100000:0.0:1787779499.233127:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505031040 00000100:00100000:0.0:1787779499.233191:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 170 00000100:00100000:0.0:1787779499.233211:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ebd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+10:5601:x1874622505031040:12345-192.168.201.9@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787779499.233676:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ebd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+10:5601:x1874622505031040:12345-192.168.201.9@tcp:501:ll_cfg_requeue.0 Request processed in 474us (764us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787779499.233685:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 170 00000100:00100000:2.0:1787779499.446172:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e842fef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c28aae66-2825-42c5-8f52-61f687e868c9:3306:1874622524981888:0@lo:400:kworker.0 00000100:00100000:2.0:1787779499.446275:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779499.446359:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e842fed2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1874622524982400:0@lo:400:kworker.0 00000100:00100000:2.0:1787779499.446387:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779499.446422:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787779499.446428:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e842fef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874622524982016:0@lo:400:kworker.0 00000100:00100000:2.0:1787779499.446448:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779499.446464:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e842fed680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622524982528:0@lo:400:kworker.0 00000100:00100000:2.0:1787779499.446498:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779499.446525:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e842fee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874622524982272:0@lo:400:kworker.0 00000100:00100000:0.0:1787779499.447012:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524981888 00000100:00100000:0.0:1787779499.447022:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524981888 00000100:00100000:0.0:1787779499.447080:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1787779499.447090:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ebe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+19:3306:x1874622524981888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779499.447159:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ebe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+19:3306:x1874622524981888:12345-0@lo:400:kworker.0 Request processed in 71us (884us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779499.447167:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1787779499.447317:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524982400 00000100:00100000:0.0:1787779499.447321:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524982400 00000100:00100000:0.0:1787779499.447708:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524982016 00000100:00100000:0.0:1787779499.447739:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524982016 00000100:00100000:0.0:1787779499.447761:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787779499.447768:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f6b52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874622524982400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779499.447826:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f6b52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874622524982400:12345-0@lo:400:kworker.0 Request processed in 59us (1438us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779499.447833:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787779499.447846:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787779499.447852:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f6b70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874622524982016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779499.447877:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f6b70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874622524982016:12345-0@lo:400:kworker.0 Request processed in 26us (1428us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779499.447883:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787779499.447941:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e842fef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874622524982016:0@lo:400:kworker.0 00000100:00100000:0.0:1787779499.447952:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e842fef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c28aae66-2825-42c5-8f52-61f687e868c9:3306:1874622524981888:0@lo:400:kworker.0 00000100:00100000:0.0:1787779499.447960:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e842fed2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1874622524982400:0@lo:400:kworker.0 00000100:00080000:0.0:1787779499.447991:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787779499.448304:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779499.448502:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787779499.448514:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e842fef840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1874622524982144:0@lo:400:kworker.0 00000100:00100000:2.0:1787779499.448740:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779499.448775:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524982144 00000100:00100000:2.0:1787779499.448788:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524982144 00000100:00100000:2.0:1787779499.448826:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787779499.448833:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f6b61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874622524982144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779499.448873:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f6b61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874622524982144:12345-0@lo:400:kworker.0 Request processed in 40us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779499.448879:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1787779499.448898:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787779499.448917:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e842fef840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1874622524982144:0@lo:400:kworker.0 00000100:00100000:3.0:1787779499.449156:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524982528 00000100:00100000:3.0:1787779499.449161:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524982528 00000100:00100000:3.0:1787779499.449214:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524982272 00000100:00100000:3.0:1787779499.449217:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524982272 00000100:00100000:3.0:1787779499.449231:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787779499.449238:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f6b5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622524982528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779499.449282:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f6b5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622524982528:12345-0@lo:400:kworker.0 Request processed in 46us (2784us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779499.449288:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787779499.449311:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787779499.449317:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f6b7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874622524982272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779499.449358:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f6b7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874622524982272:12345-0@lo:400:kworker.0 Request processed in 42us (2810us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779499.449364:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1787779499.449405:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e842fed680 x1874622524982528/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779515 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779499.449416:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e842fed680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622524982528:0@lo:400:kworker.0 00000100:00080000:2.0:1787779499.451120:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787779499.451183:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e842fee940 x1874622524982272/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779515 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779499.451210:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e842fee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874622524982272:0@lo:400:kworker.0 00010000:00010000:2.0:1787779499.638263:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779499.958323:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e842fef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874622524982656:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787779499.958400:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779499.958651:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524982656 00000100:00100000:0.0:1787779499.958668:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524982656 00000100:00100000:0.0:1787779499.958754:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787779499.958764:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ece6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874622524982656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787779499.958799:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787779499.958849:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ece6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874622524982656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779499.958856:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1787779499.958933:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e842fef480 x1874622524982656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779515 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779499.958951:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e842fef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874622524982656:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787779500.193592:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779500.193635:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779500.193664:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779500.193691:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779500.193745:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505031424 00000100:00100000:3.0:1787779500.193754:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505031424 00000100:00100000:3.0:1787779500.193809:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505031552 00000100:00100000:3.0:1787779500.193812:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505031552 00000100:00100000:3.0:1787779500.193831:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 18 00000100:00100000:3.0:1787779500.193841:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a70bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+5:2357:x1874622505031424:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:3.0:1787779500.193919:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a70bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+5:2357:x1874622505031424:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 80us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779500.193928:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 18 00000100:00100000:3.0:1787779500.193944:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 19 00000100:00100000:3.0:1787779500.193950:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e855a62580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+5:2358:x1874622505031552:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:3.0:1787779500.193972:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e855a62580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+5:2358:x1874622505031552:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 23us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779500.193978:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 19 00000100:00080000:3.0:1787779500.193998:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787779500.194011:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787779500.194276:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505031296 00000100:00100000:0.0:1787779500.194282:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505031296 00000100:00100000:0.0:1787779500.194815:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 33 00000100:00100000:0.0:1787779500.194827:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e855b00f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:2358:x1874622505031296:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:0.0:1787779500.194891:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e855b00f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:2358:x1874622505031296:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 67us (1254us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779500.194898:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 33 00000100:00080000:3.0:1787779500.198497:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787779500.198977:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505031168 00000100:00100000:1.0:1787779500.198989:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505031168 00000100:00100000:1.0:1787779500.199054:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 172 00000100:00100000:1.0:1787779500.199065:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ebd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+10:2357:x1874622505031168:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:1.0:1787779500.199132:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ebd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+10:2357:x1874622505031168:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 70us (5550us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779500.199140:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 172 00000020:00000080:2.0:1787779500.618089:0:8498:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffc3f7d6c0 20000000:00000080:2.0:1787779500.618105:0:8498:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98e87ab16800 uarg=0000000000000000 20000000:01000000:2.0:1787779500.618138:0:8498:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787779500.618143:0:8498:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787779500.618148:0:8498:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1787779500.618915:0:8499:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1787779500.619118:0:8498:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1787779500.624999:0:8498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1787779500.627133:0:8498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1787779500.627255:0:8498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1787779500.627290:0:8498:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787779500.627312:0:8498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98e848f68400/0x9e63ba8af6888fde lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779500.627330:0:8498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98e8429d5400/0x9e63ba8af6888d53 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af6888d4c expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779500.627338:0:8498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98e8429d5000/0x9e63ba8af6888db5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af6888dae expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779500.627343:0:8498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98e848f68000/0x9e63ba8af6888e80 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af6888e79 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779500.627353:0:8498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98e882049a00/0x9e63ba8af6888f3d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedab3e expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779500.627360:0:8498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98e848f68400/0x9e63ba8af6888fde lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779500.627404:0:8498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98e882049a00/0x9e63ba8af6888f3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedab3e expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779500.627420:0:8498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98e882049a00/0x9e63ba8af6888f3d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedab3e expref: 9 pid: 5831 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779500.627449:0:8498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e842fecf00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8498:1874622524982784:192.168.201.9@tcp:104: 00010000:00010000:0.0:1787779500.627662:0:8498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98e848f68000/0x9e63ba8af6888e80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9e63ba8af6888e79 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779500.627671:0:8498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98e848f68000/0x9e63ba8af6888e80 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9e63ba8af6888e79 expref: 18 pid: 5830 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779500.627680:0:8498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e842fee1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8498:1874622524982912:0@lo:104: 00000100:00100000:0.0:1787779500.627847:0:8498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787779500.627889:0:8498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98e8429d5000/0x9e63ba8af6888db5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9e63ba8af6888dae expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779500.627898:0:8498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98e8429d5000/0x9e63ba8af6888db5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9e63ba8af6888dae expref: 18 pid: 5828 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779500.627906:0:8498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e842fec000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8498:1874622524983040:0@lo:104: 00000100:00100000:0.0:1787779500.627931:0:8498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787779500.627957:0:8498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98e8429d5400/0x9e63ba8af6888d53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9e63ba8af6888d4c expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779500.627966:0:8498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98e8429d5400/0x9e63ba8af6888d53 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9e63ba8af6888d4c expref: 18 pid: 5828 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779500.627974:0:8498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e842feed00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8498:1874622524983168:0@lo:104: 00000100:00100000:0.0:1787779500.627992:0:8498:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e844dd5780 going to sleep for 11 seconds 00000100:00100000:1.0:1787779500.628113:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787779500.628131:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779500.628143:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524982912 00000100:00100000:1.0:1787779500.628149:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524982912 00000100:00100000:1.0:1787779500.628186:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524983040 00000100:00100000:1.0:1787779500.628189:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524983040 00000100:00100000:1.0:1787779500.628199:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524983168 00000100:00100000:1.0:1787779500.628201:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524983168 00000100:00100000:1.0:1787779500.628211:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787779500.628219:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842fec780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c28aae66-2825-42c5-8f52-61f687e868c9+5:8498:x1874622524982912:12345-0@lo:104: 00010000:00010000:1.0:1787779500.628230:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.109@tcp lock: ffff98e848f69600/0x9e63ba8af6888e79 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9e63ba8af6888e80 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779500.628296:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787779500.628302:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842fec780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c28aae66-2825-42c5-8f52-61f687e868c9+5:8498:x1874622524982912:12345-0@lo:104: Request processed in 84us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779500.628309:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787779500.628324:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787779500.628329:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f648850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c28aae66-2825-42c5-8f52-61f687e868c9+4:8498:x1874622524983040:12345-0@lo:104: 00010000:00010000:1.0:1787779500.628336:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.109@tcp lock: ffff98e841649600/0x9e63ba8af6888dae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9e63ba8af6888db5 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779500.628364:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787779500.628369:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f648850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c28aae66-2825-42c5-8f52-61f687e868c9+4:8498:x1874622524983040:12345-0@lo:104: Request processed in 40us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779500.628375:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787779500.628409:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787779500.628415:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ece6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c28aae66-2825-42c5-8f52-61f687e868c9+3:8498:x1874622524983168:12345-0@lo:104: 00010000:00010000:1.0:1787779500.628422:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.109@tcp lock: ffff98e840030400/0x9e63ba8af6888d4c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9e63ba8af6888d53 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779500.628447:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787779500.628451:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ece6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c28aae66-2825-42c5-8f52-61f687e868c9+3:8498:x1874622524983168:12345-0@lo:104: Request processed in 38us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779500.628456:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787779500.628460:0:8498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e842fee1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8498:1874622524982912:0@lo:104: 00000100:00100000:0.0:1787779500.628469:0:8498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e842fec000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8498:1874622524983040:0@lo:104: 00010000:00010000:1.0:1787779500.628471:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787779500.628477:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff98e848f69600/0x9e63ba8af6888e79 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9e63ba8af6888e80 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779500.628483:0:8498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e842feed00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8498:1874622524983168:0@lo:104: 00010000:00010000:1.0:1787779500.628484:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e848f69600 already unused, calling callback (ffffffffc1cd5c20) 10000000:00010000:1.0:1787779500.628492:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff98e848f69600/0x9e63ba8af6888e79 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9e63ba8af6888e80 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779500.628500:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff98e848f69600/0x9e63ba8af6888e79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9e63ba8af6888e80 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779500.628506:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 10000000:00010000:1.0:1787779500.628507:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff98e848f69600/0x9e63ba8af6888e79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9e63ba8af6888e80 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787779500.628513:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787779500.630771:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.109@tcp lock: ffff98e848f69600/0x9e63ba8af6888e79 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af6888e80 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779500.630789:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787779500.630822:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff98e848f69600/0x9e63ba8af6888e79 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af6888e80 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779500.630830:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff98e848f69600/0x9e63ba8af6888e79 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af6888e80 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779500.630852:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787779500.630856:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff98e840030400/0x9e63ba8af6888d4c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9e63ba8af6888d53 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779500.630863:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e840030400 already unused, calling callback (ffffffffc1cd5c20) 10000000:00010000:0.0:1787779500.630867:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff98e840030400/0x9e63ba8af6888d4c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9e63ba8af6888d53 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779500.630877:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff98e840030400/0x9e63ba8af6888d4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9e63ba8af6888d53 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787779500.630884:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff98e840030400/0x9e63ba8af6888d4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9e63ba8af6888d53 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787779500.630890:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787779500.630926:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.109@tcp lock: ffff98e840030400/0x9e63ba8af6888d4c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af6888d53 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779500.630932:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787779500.630961:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff98e840030400/0x9e63ba8af6888d4c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af6888d53 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779500.630968:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff98e840030400/0x9e63ba8af6888d4c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af6888d53 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779500.630979:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779500.630981:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779500.630983:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779500.631023:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ece4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c28aae66-2825-42c5-8f52-61f687e868c9:3305:1874622524983296:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787779500.631099:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779500.631256:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524983296 00000100:00100000:0.0:1787779500.631262:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524983296 00010000:00010000:0.0:1787779500.631473:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98e848f68000/0x9e63ba8af6888e80 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9e63ba8af6888e79 expref: 19 pid: 5830 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779500.631506:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787779500.631515:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842fef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c28aae66-2825-42c5-8f52-61f687e868c9+19:3305:x1874622524983296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787779500.631600:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787779500.631607:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98e848f68000/0x9e63ba8af6888e80 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9e63ba8af6888e79 expref: 19 pid: 5830 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779500.631618:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98e848f68000/0x9e63ba8af6888e80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9e63ba8af6888e79 expref: 19 pid: 5830 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779500.631634:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e848f68000/0x9e63ba8af6888e80 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9e63ba8af6888e79 expref: 19 pid: 5830 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779500.631646:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787779500.631687:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842fef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c28aae66-2825-42c5-8f52-61f687e868c9+18:3305:x1874622524983296:12345-0@lo:103:ldlm_bl.0 Request processed in 173us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779500.631701:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787779500.631835:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ece4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c28aae66-2825-42c5-8f52-61f687e868c9:3305:1874622524983296:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787779500.631911:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779500.631917:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff98e841649600/0x9e63ba8af6888dae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9e63ba8af6888db5 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779500.631925:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e841649600 already unused, calling callback (ffffffffc1cd5c20) 10000000:00010000:0.0:1787779500.631928:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff98e841649600/0x9e63ba8af6888dae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9e63ba8af6888db5 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779500.632591:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff98e841649600/0x9e63ba8af6888dae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9e63ba8af6888db5 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787779500.632600:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff98e841649600/0x9e63ba8af6888dae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9e63ba8af6888db5 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787779500.632606:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787779500.632647:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.109@tcp lock: ffff98e841649600/0x9e63ba8af6888dae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af6888db5 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779500.632654:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787779500.632665:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff98e841649600/0x9e63ba8af6888dae lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af6888db5 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779500.632672:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff98e841649600/0x9e63ba8af6888dae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af6888db5 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779500.632691:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779500.632693:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779500.632704:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779500.632815:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779500.632818:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779500.632855:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e842fec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c28aae66-2825-42c5-8f52-61f687e868c9:3306:1874622524983424:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787779500.632900:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779500.632929:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787779500.632934:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e842fee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c28aae66-2825-42c5-8f52-61f687e868c9:3306:1874622524983552:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787779500.632958:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779500.632983:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524983424 00000100:00100000:0.0:1787779500.632989:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524983424 00010000:00010000:0.0:1787779500.633011:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98e8429d5400/0x9e63ba8af6888d53 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9e63ba8af6888d4c expref: 18 pid: 5828 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779500.633043:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524983552 00000100:00100000:0.0:1787779500.633047:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524983552 00010000:00010000:0.0:1787779500.633060:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98e8429d5000/0x9e63ba8af6888db5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9e63ba8af6888dae expref: 19 pid: 5828 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779500.633073:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787779500.633080:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842fed680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c28aae66-2825-42c5-8f52-61f687e868c9+19:3306:x1874622524983424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787779500.633089:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787779500.633094:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98e8429d5400/0x9e63ba8af6888d53 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9e63ba8af6888d4c expref: 19 pid: 5828 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779500.633103:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98e8429d5400/0x9e63ba8af6888d53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9e63ba8af6888d4c expref: 19 pid: 5828 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779500.633116:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e8429d5400/0x9e63ba8af6888d53 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9e63ba8af6888d4c expref: 19 pid: 5828 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779500.633140:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787779500.633171:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842fed680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c28aae66-2825-42c5-8f52-61f687e868c9+18:3306:x1874622524983424:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779500.633193:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787779500.633210:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787779500.633216:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842fef840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c28aae66-2825-42c5-8f52-61f687e868c9+17:3306:x1874622524983552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787779500.633224:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787779500.633229:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98e8429d5000/0x9e63ba8af6888db5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9e63ba8af6888dae expref: 17 pid: 5828 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779500.633237:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98e8429d5000/0x9e63ba8af6888db5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9e63ba8af6888dae expref: 17 pid: 5828 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779500.633246:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e8429d5000/0x9e63ba8af6888db5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9e63ba8af6888dae expref: 17 pid: 5828 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779500.633253:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787779500.633508:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842fef840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c28aae66-2825-42c5-8f52-61f687e868c9+16:3306:x1874622524983552:12345-0@lo:103:ldlm_bl.0 Request processed in 291us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779500.633515:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787779500.633619:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e842fee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c28aae66-2825-42c5-8f52-61f687e868c9:3306:1874622524983552:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787779500.633629:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e842fec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c28aae66-2825-42c5-8f52-61f687e868c9:3306:1874622524983424:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787779500.640263:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779500.640361:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505031680 00000100:00100000:2.0:1787779500.640372:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505031680 00010000:00010000:2.0:1787779500.640410:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98e882049a00/0x9e63ba8af6888f3d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedab3e expref: 10 pid: 5831 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779500.640451:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 24 00000100:00100000:2.0:1787779500.640459:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e855a63480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+10:2360:x1874622505031680:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787779500.640473:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787779500.640478:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98e882049a00/0x9e63ba8af6888f3d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedab3e expref: 10 pid: 5831 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779500.640502:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98e882049a00/0x9e63ba8af6888f3d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedab3e expref: 10 pid: 5831 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779500.640522:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98e848f68400/0x9e63ba8af6888fde lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779500.640531:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e848f68400/0x9e63ba8af6888fde lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779500.640562:0:5821:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98e848f68400/0x9e63ba8af6888fde lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779500.640570:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98e848f68400/0x9e63ba8af6888fde lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779500.640578:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98e848f68400/0x9e63ba8af6888fde lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779500.640585:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98e848f68400/0x9e63ba8af6888fde lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779500.640591:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e848f68400 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:2.0:1787779500.640595:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98e848f68400/0x9e63ba8af6888fde lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779500.640602:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98e848f68400/0x9e63ba8af6888fde lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779500.640611:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98e848f68400/0x9e63ba8af6888fde lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779500.640632:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787779500.640697:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e855a63480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+10:2360:x1874622505031680:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 237us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779500.640706:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 24 00010000:00010000:0.0:1787779500.640831:0:8498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e882049a00/0x9e63ba8af6888f3d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedab3e expref: 10 pid: 5831 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779500.640849:0:8498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e842fecf00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8498:1874622524982784:192.168.201.9@tcp:104: 00010000:00010000:0.0:1787779500.640900:0:8498:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98e848f68400/0x9e63ba8af6888fde lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779500.640910:0:8498:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98e848f68400/0x9e63ba8af6888fde lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779500.640917:0:8498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98e848f68400/0x9e63ba8af6888fde lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779500.640923:0:8498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e848f68400/0x9e63ba8af6888fde lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779500.658904:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779501.094978:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779501.095149:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505031808 00000100:00100000:2.0:1787779501.095161:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505031808 00000100:00100000:2.0:1787779501.095232:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 173 00000100:00100000:2.0:1787779501.095243:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ebc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+9:5601:x1874622505031808:12345-192.168.201.9@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787779501.095259:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779501.095281:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e841649c00/0x9e63ba8af6888fe5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedab7d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779501.095319:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e841649c00/0x9e63ba8af6888fe5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedab7d expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779501.095331:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e841649c00/0x9e63ba8af6888fe5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedab7d expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779501.095340:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e841649c00, rc 0) 00000100:00100000:2.0:1787779501.095408:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ebc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+10:5601:x1874622505031808:12345-192.168.201.9@tcp:101:ll_cfg_requeue.0 Request processed in 167us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779501.095415:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 173 00000100:00100000:1.0:1787779501.121557:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779501.122078:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505031936 00000100:00100000:3.0:1787779501.122089:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505031936 00000100:00100000:3.0:1787779501.122273:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 174 00000100:00100000:3.0:1787779501.122285:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ebf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+10:5601:x1874622505031936:12345-192.168.201.9@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787779501.122607:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ebf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+10:5601:x1874622505031936:12345-192.168.201.9@tcp:501:ll_cfg_requeue.0 Request processed in 323us (1058us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779501.122616:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 174 00000100:00100000:0.0:1787779501.129350:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779501.129430:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505032064 00000100:00100000:1.0:1787779501.129440:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505032064 00000100:00100000:1.0:1787779501.129496:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 175 00000100:00100000:1.0:1787779501.129505:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ebe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+10:5601:x1874622505032064:12345-192.168.201.9@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787779501.129768:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ebe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+10:5601:x1874622505032064:12345-192.168.201.9@tcp:503:ll_cfg_requeue.0 Request processed in 263us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779501.129777:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 175 00000100:00100000:0.0:1787779501.135577:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779501.135864:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505032192 00000100:00100000:3.0:1787779501.135873:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505032192 00000100:00100000:3.0:1787779501.135930:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 176 00000100:00100000:3.0:1787779501.135940:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ebec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+10:6134:x1874622505032192:12345-192.168.201.9@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787779501.136427:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ebec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+10:6134:x1874622505032192:12345-192.168.201.9@tcp:502:llog_process_th.0 Request processed in 488us (858us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779501.136436:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 176 00000100:00100000:3.0:1787779501.160666:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779501.160883:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505032320 00000100:00100000:2.0:1787779501.160895:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505032320 00000100:00100000:2.0:1787779501.160961:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 177 00000100:00100000:2.0:1787779501.160980:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ebc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+10:6134:x1874622505032320:12345-192.168.201.9@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787779501.161246:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ebc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+10:6134:x1874622505032320:12345-192.168.201.9@tcp:502:llog_process_th.0 Request processed in 275us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779501.161255:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 177 00010000:00010000:0.0:1787779501.685457:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787779502.642843:0:5833:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787779502.642851:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98e87a56c800 from 4 10000000:01000000:0.0:1787779502.642856:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787779502.642902:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e848f68400/0x9e63ba8af6888fec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779502.642914:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff98e848f68400/0x9e63ba8af6888fec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779502.642925:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff98e848f68400/0x9e63ba8af6888fec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779502.643080:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e842fecf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524983680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787779502.643155:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779502.645112:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e8496d4180 going to sleep for 11 seconds 00000100:00100000:3.0:1787779502.648172:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524983680 00000100:00100000:3.0:1787779502.648185:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524983680 00000100:00100000:3.0:1787779502.648305:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1787779502.648317:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ebd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+16:5833:x1874622524983680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787779502.648340:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779502.648362:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e8429d5c00/0x9e63ba8af6888ff3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9e63ba8af6888fec expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779502.648408:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e8429d5c00/0x9e63ba8af6888ff3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9e63ba8af6888fec expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779502.648419:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e8429d5c00/0x9e63ba8af6888ff3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af6888fec expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779502.648430:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e8429d5c00, rc 0) 00000100:00100000:3.0:1787779502.648522:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ebd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+17:5833:x1874622524983680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 207us (5365us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779502.648529:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1787779502.648625:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e842fecf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524983680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787779502.648644:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff98e848f68400/0x9e63ba8af6888fec lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888ff3 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779502.648653:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff98e848f68400/0x9e63ba8af6888fec lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9e63ba8af6888ff3 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779502.648752:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e842fecf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524983808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787779502.648786:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779502.651355:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e8496d4180 going to sleep for 11 seconds 00000100:00100000:2.0:1787779502.658589:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524983808 00000100:00100000:2.0:1787779502.658607:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524983808 00000100:00100000:2.0:1787779502.658678:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1787779502.658689:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+17:5833:x1874622524983808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787779502.659069:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+17:5833:x1874622524983808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 381us (10282us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779502.659077:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1787779502.659128:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e842fecf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524983808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787779502.659176:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f6b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524983936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787779502.659216:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779502.659244:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e87eb42540 going to sleep for 11 seconds 00000100:00100000:2.0:1787779502.659256:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524983936 00000100:00100000:2.0:1787779502.659260:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524983936 00000100:00100000:2.0:1787779502.659277:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1787779502.659282:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+17:5833:x1874622524983936:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787779502.659414:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+17:5833:x1874622524983936:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 131us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779502.659420:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1787779502.659452:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f6b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524983936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787779502.659649:0:8570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f6b7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c28aae66-2825-42c5-8f52-61f687e868c9:8570:1874622524984064:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787779502.659678:0:8570:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779502.659701:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524984064 00000100:00100000:2.0:1787779502.659706:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524984064 00000100:00100000:2.0:1787779502.659743:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787779502.659749:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+17:8570:x1874622524984064:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787779502.659865:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+17:8570:x1874622524984064:12345-0@lo:502:llog_process_th.0 Request processed in 116us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779502.659872:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787779502.659900:0:8570:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e87eb42480 going to sleep for 11 seconds 00000100:00100000:2.0:1787779502.659911:0:8570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f6b7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c28aae66-2825-42c5-8f52-61f687e868c9:8570:1874622524984064:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787779502.659932:0:8570:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787779502.659942:0:8570:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787779502.659944:0:8570:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787779502.659950:0:8570:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98e87a56c800 00000020:00000080:2.0:1787779502.659952:0:8570:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787779502.660043:0:8570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f6b7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c28aae66-2825-42c5-8f52-61f687e868c9:8570:1874622524984192:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787779502.660074:0:8570:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779502.660093:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524984192 00000100:00100000:2.0:1787779502.660097:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524984192 00000100:00100000:2.0:1787779502.660114:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787779502.660119:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+17:8570:x1874622524984192:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787779502.660220:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+17:8570:x1874622524984192:12345-0@lo:502:llog_process_th.0 Request processed in 100us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779502.660227:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787779502.660259:0:8570:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e87eb42480 going to sleep for 11 seconds 00000100:00100000:2.0:1787779502.660270:0:8570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f6b7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c28aae66-2825-42c5-8f52-61f687e868c9:8570:1874622524984192:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787779502.660288:0:8570:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787779502.660296:0:8570:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787779502.660297:0:8570:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787779502.660301:0:8570:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787779502.660354:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787779502.660370:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787779502.660378:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e848f68400/0x9e63ba8af6888fec lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888ff3 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779502.660388:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff98e848f68400/0x9e63ba8af6888fec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888ff3 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787779502.660397:0:5833:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787779502.660399:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98e848ee5800 from 4 10000000:01000000:2.0:1787779502.660402:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787779502.660423:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e841648600/0x9e63ba8af6888ffa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779502.660431:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff98e841648600/0x9e63ba8af6888ffa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779502.660439:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff98e841648600/0x9e63ba8af6888ffa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779502.660451:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f6b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524984320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787779502.660474:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779502.660486:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e87eb42480 going to sleep for 11 seconds 00000100:00100000:2.0:1787779502.660498:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524984320 00000100:00100000:2.0:1787779502.660501:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524984320 00000100:00100000:2.0:1787779502.660519:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1787779502.660524:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+17:5833:x1874622524984320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787779502.660531:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779502.660548:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e841649e00/0x9e63ba8af6889001 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9e63ba8af6888ffa expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779502.660568:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e841649e00/0x9e63ba8af6889001 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9e63ba8af6888ffa expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779502.660578:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e841649e00/0x9e63ba8af6889001 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af6888ffa expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779502.660586:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e841649e00, rc 0) 00000100:00100000:2.0:1787779502.660614:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+18:5833:x1874622524984320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 90us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779502.660620:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1787779502.660649:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f6b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524984320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787779502.660660:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff98e841648600/0x9e63ba8af6888ffa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6889001 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779502.660668:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff98e841648600/0x9e63ba8af6888ffa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9e63ba8af6889001 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779502.660703:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f6b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524984448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787779502.660749:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779502.660763:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e87eb42480 going to sleep for 11 seconds 00000100:00100000:2.0:1787779502.660773:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524984448 00000100:00100000:2.0:1787779502.660776:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524984448 00000100:00100000:2.0:1787779502.660792:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787779502.660797:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+18:5833:x1874622524984448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787779502.660965:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+18:5833:x1874622524984448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 167us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779502.660976:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787779502.661023:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f6b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524984448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787779502.661048:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f6b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524984576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787779502.661078:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779502.661090:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e87eb42480 going to sleep for 11 seconds 00000100:00100000:2.0:1787779502.661100:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524984576 00000100:00100000:2.0:1787779502.661104:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524984576 00000100:00100000:2.0:1787779502.661121:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1787779502.661127:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+18:5833:x1874622524984576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787779502.661237:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+18:5833:x1874622524984576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 109us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779502.661244:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1787779502.661278:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f6b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524984576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787779502.667784:0:8571:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855a603c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c28aae66-2825-42c5-8f52-61f687e868c9:8571:1874622524984704:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787779502.668035:0:8571:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779502.668084:0:8571:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e852bfd180 going to sleep for 11 seconds 00000100:00100000:2.0:1787779502.668953:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524984704 00000100:00100000:2.0:1787779502.668962:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524984704 00000100:00100000:2.0:1787779502.669022:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1787779502.669032:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+18:8571:x1874622524984704:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787779502.669260:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+18:8571:x1874622524984704:12345-0@lo:502:llog_process_th.0 Request processed in 230us (1225us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779502.669268:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1787779502.673027:0:8571:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855a603c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c28aae66-2825-42c5-8f52-61f687e868c9:8571:1874622524984704:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787779502.673080:0:8571:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787779502.673095:0:8571:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787779502.673099:0:8571:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787779502.673118:0:8571:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98e848ee5800 00000020:00000080:2.0:1787779502.673121:0:8571:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787779502.673231:0:8571:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f6b7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c28aae66-2825-42c5-8f52-61f687e868c9:8571:1874622524984832:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787779502.673308:0:8571:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779502.682807:0:8571:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e87eb42180 going to sleep for 11 seconds 00000100:00100000:1.0:1787779502.683041:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524984832 00000100:00100000:1.0:1787779502.683052:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524984832 00000100:00100000:1.0:1787779502.684915:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1787779502.684941:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+18:8571:x1874622524984832:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787779502.685297:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+18:8571:x1874622524984832:12345-0@lo:502:llog_process_th.0 Request processed in 365us (11989us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779502.692839:0:8571:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f6b7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c28aae66-2825-42c5-8f52-61f687e868c9:8571:1874622524984832:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787779502.692889:0:8571:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787779502.692900:0:8571:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787779502.692903:0:8571:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787779502.692908:0:8571:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787779502.693106:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787779502.693123:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787779502.693135:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e841648600/0x9e63ba8af6888ffa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6889001 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779502.693145:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff98e841648600/0x9e63ba8af6888ffa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6889001 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787779502.693155:0:5833:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787779502.693157:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98e846b05800 from 4 10000000:01000000:2.0:1787779502.693160:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787779502.693194:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e841649600/0x9e63ba8af6889008 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779502.693202:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff98e841649600/0x9e63ba8af6889008 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779502.693210:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff98e841649600/0x9e63ba8af6889008 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779502.693241:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f6b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524984960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787779502.693308:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779502.693347:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e87eb42180 going to sleep for 11 seconds 00000100:00100000:2.0:1787779502.693363:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524984960 00000100:00100000:2.0:1787779502.693369:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524984960 00000100:00100000:2.0:1787779502.693408:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1787779502.693416:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+19:5833:x1874622524984960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787779502.693429:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779502.693453:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e87aa66800/0x9e63ba8af688900f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9e63ba8af6889008 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779502.693475:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e87aa66800/0x9e63ba8af688900f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9e63ba8af6889008 expref: 20 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779502.693484:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e87aa66800/0x9e63ba8af688900f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af6889008 expref: 20 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779502.693492:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87aa66800, rc 0) 00000100:00100000:2.0:1787779502.693526:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+20:5833:x1874622524984960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779502.693534:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1787779502.693570:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f6b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524984960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787779502.693582:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff98e841649600/0x9e63ba8af6889008 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af688900f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779502.693591:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff98e841649600/0x9e63ba8af6889008 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9e63ba8af688900f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779502.693642:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f6b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524985088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787779502.693672:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779502.693684:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e87eb42180 going to sleep for 11 seconds 00000100:00100000:2.0:1787779502.693695:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524985088 00000100:00100000:2.0:1787779502.693698:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524985088 00000100:00100000:2.0:1787779502.693740:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1787779502.693747:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+20:5833:x1874622524985088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787779502.695154:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+20:5833:x1874622524985088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1404us (1476us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779502.695165:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1787779502.695210:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f6b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524985088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787779502.695261:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f6b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524985216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787779502.695303:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779502.695328:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e87eb42180 going to sleep for 11 seconds 00000100:00100000:3.0:1787779502.695388:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524985216 00000100:00100000:3.0:1787779502.695393:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524985216 00000100:00100000:3.0:1787779502.695429:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1787779502.695437:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+20:5833:x1874622524985216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787779502.695582:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+20:5833:x1874622524985216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 146us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779502.695589:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1787779502.695760:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1787779502.695847:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f6b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622524985216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787779502.696052:0:8575:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f6b7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c28aae66-2825-42c5-8f52-61f687e868c9:8575:1874622524985344:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787779502.696089:0:8575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779502.696111:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524985344 00000100:00100000:2.0:1787779502.696115:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524985344 00000100:00100000:2.0:1787779502.696134:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1787779502.696141:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+19:8575:x1874622524985344:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787779502.696289:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+19:8575:x1874622524985344:12345-0@lo:502:llog_process_th.0 Request processed in 148us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779502.696296:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1787779502.696323:0:8575:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e87eb426c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787779502.696334:0:8575:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f6b7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c28aae66-2825-42c5-8f52-61f687e868c9:8575:1874622524985344:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787779502.696361:0:8575:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787779502.696371:0:8575:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787779502.696373:0:8575:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787779502.696381:0:8575:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98e846b05800 00000020:00000080:2.0:1787779502.696383:0:8575:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787779502.696814:0:8575:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f6b7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c28aae66-2825-42c5-8f52-61f687e868c9:8575:1874622524985472:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787779502.696849:0:8575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779502.696871:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524985472 00000100:00100000:2.0:1787779502.696875:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524985472 00000100:00100000:2.0:1787779502.696896:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1787779502.696903:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e844dc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+19:8575:x1874622524985472:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787779502.697025:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e844dc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+19:8575:x1874622524985472:12345-0@lo:502:llog_process_th.0 Request processed in 122us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779502.697032:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1787779502.697057:0:8575:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e844c19600 going to sleep for 11 seconds 00000100:00100000:2.0:1787779502.697071:0:8575:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f6b7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c28aae66-2825-42c5-8f52-61f687e868c9:8575:1874622524985472:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787779502.697088:0:8575:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787779502.697093:0:8575:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787779502.697095:0:8575:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787779502.697098:0:8575:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787779502.697147:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787779502.697163:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787779502.697175:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e841649600/0x9e63ba8af6889008 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af688900f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779502.697186:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff98e841649600/0x9e63ba8af6889008 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af688900f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779502.710873:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779503.539284:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787779503.539311:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f6b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874622524985600:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787779503.539390:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779503.539918:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524985600 00000100:00100000:1.0:1787779503.539936:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524985600 00000100:00080000:3.0:1787779503.540075:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787779503.540193:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787779503.540218:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e855a60f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874622524985600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787779503.540256:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787779503.540322:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e855a60f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874622524985600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (932us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779503.540331:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1787779503.540421:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e87f6b7480 x1874622524985600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779519 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779503.540451:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f6b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874622524985600:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787779503.731021:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779504.567920:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e842fee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874622524985856:0@lo:400:kworker.0 00000100:00100000:0.0:1787779504.568008:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779504.568091:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524985856 00000100:00100000:0.0:1787779504.568100:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524985856 00000100:00100000:0.0:1787779504.568152:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787779504.568162:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842fec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874622524985856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779504.568229:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842fec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874622524985856:12345-0@lo:400:kworker.0 Request processed in 68us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779504.568236:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787779504.568280:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e842fee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874622524985856:0@lo:400:kworker.0 00000100:00100000:0.0:1787779504.568315:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787779504.568322:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e842fee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874622524985984:0@lo:400:kworker.0 00000100:00100000:0.0:1787779504.568346:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779504.568375:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524985984 00000100:00100000:0.0:1787779504.568379:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524985984 00000100:00100000:0.0:1787779504.568416:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787779504.568437:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842fee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874622524985984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779504.568486:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842fee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874622524985984:12345-0@lo:400:kworker.0 Request processed in 50us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779504.568492:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:0.0:1787779504.568511:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787779504.568532:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e842fee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874622524985984:0@lo:400:kworker.0 00000100:00100000:0.0:1787779504.568578:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e842fec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622524986368:0@lo:400:kworker.0 00000100:00100000:0.0:1787779504.568621:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779504.568658:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524986368 00000100:00100000:0.0:1787779504.568662:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524986368 00000100:00100000:0.0:1787779504.568694:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787779504.568701:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842fecb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622524986368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779504.568767:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842fecb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622524986368:12345-0@lo:400:kworker.0 Request processed in 66us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779504.568773:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1787779504.568791:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787779504.568809:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e842fec3c0 x1874622524986368/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779520 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779504.568819:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e842fec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622524986368:0@lo:400:kworker.0 00000100:00100000:3.0:1787779504.569424:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e842fec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c28aae66-2825-42c5-8f52-61f687e868c9:3305:1874622524985728:0@lo:400:kworker.0 00000100:00100000:3.0:1787779504.569466:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779504.569519:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e842feda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874622524986240:0@lo:400:kworker.0 00000100:00100000:3.0:1787779504.569547:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779504.569565:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787779504.569571:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e842fee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874622524986112:0@lo:400:kworker.0 00000100:00100000:3.0:1787779504.569603:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779504.569644:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524986112 00000100:00100000:3.0:1787779504.569648:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524986112 00000100:00100000:3.0:1787779504.569676:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787779504.569683:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e855a63840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874622524986112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779504.569747:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e855a63840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874622524986112:12345-0@lo:400:kworker.0 Request processed in 64us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779504.569754:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1787779504.569784:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e842fee1c0 x1874622524986112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779520 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779504.569795:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e842fee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874622524986112:0@lo:400:kworker.0 00000100:00100000:2.0:1787779504.570063:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524986240 00000100:00100000:2.0:1787779504.570068:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524986240 00000100:00100000:2.0:1787779504.570120:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787779504.570127:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e855a62940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874622524986240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779504.570170:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e855a62940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874622524986240:12345-0@lo:400:kworker.0 Request processed in 44us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779504.570177:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787779504.570288:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e842feda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874622524986240:0@lo:400:kworker.0 00000100:00100000:0.0:1787779504.570359:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524985728 00000100:00100000:0.0:1787779504.570363:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524985728 00000100:00100000:0.0:1787779504.570399:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1787779504.570407:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e844dc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+19:3305:x1874622524985728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779504.570446:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e844dc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+19:3305:x1874622524985728:12345-0@lo:400:kworker.0 Request processed in 40us (980us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779504.570467:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1787779504.570613:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e842fec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c28aae66-2825-42c5-8f52-61f687e868c9:3305:1874622524985728:0@lo:400:kworker.0 00000100:00080000:3.0:1787779504.571317:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787779504.759793:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787779505.075937:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e842fec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622524986496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787779505.076279:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779505.076407:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524986496 00000100:00100000:3.0:1787779505.076415:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524986496 00000100:00100000:3.0:1787779505.076496:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787779505.076506:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f6b5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622524986496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787779505.076541:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787779505.076637:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f6b5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622524986496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 132us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779505.076644:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1787779505.076788:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e842fec3c0 x1874622524986496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779521 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779505.076806:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e842fec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622524986496:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787779505.320639:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779505.320794:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779505.320884:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779505.320891:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505032448 00000100:00100000:3.0:1787779505.320907:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505032448 00000100:00100000:0.0:1787779505.320924:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779505.320960:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505032832 00000100:00100000:0.0:1787779505.320966:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505032832 00000100:00100000:3.0:1787779505.320978:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 194 00000100:00100000:3.0:1787779505.320991:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e844dc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+10:2357:x1874622505032448:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:0.0:1787779505.321014:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505032704 00000100:00100000:0.0:1787779505.321018:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505032704 00000100:00100000:0.0:1787779505.321052:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 22 00000100:00100000:0.0:1787779505.321061:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842fec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+5:2358:x1874622505032832:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:3.0:1787779505.321073:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e844dc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+10:2357:x1874622505032448:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 85us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779505.321084:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 194 00000100:00100000:0.0:1787779505.321108:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842fec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+5:2358:x1874622505032832:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 49us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779505.321879:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 22 00000100:00100000:0.0:1787779505.321904:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 23 00000100:00100000:0.0:1787779505.321914:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842feda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+5:2358:x1874622505032704:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:0.0:1787779505.321966:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842feda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+5:2358:x1874622505032704:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 55us (1043us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779505.321973:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 23 00000100:00080000:0.0:1787779505.322001:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787779505.322007:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787779505.328674:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505032576 00000100:00100000:1.0:1787779505.328695:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505032576 00000100:00100000:3.0:1787779505.329510:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 37 00000100:00100000:3.0:1787779505.329523:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842fec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:2357:x1874622505032576:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:3.0:1787779505.329612:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842fec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:2357:x1874622505032576:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 92us (8818us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779505.329620:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 37 00000100:00080000:0.0:1787779505.333258:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787779505.783927:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779506.805744:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779507.826898:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787779508.351648:0:8798:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg109-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:0.0:1787779508.660179:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e842fee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874622524986624:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787779508.660267:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779508.660386:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524986624 00000100:00100000:0.0:1787779508.660410:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524986624 00000100:00100000:0.0:1787779508.660469:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787779508.660478:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842fecf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874622524986624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787779508.660527:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787779508.660572:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842fecf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874622524986624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779508.660579:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1787779508.660624:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e842fee1c0 x1874622524986624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779524 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779508.660642:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e842fee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874622524986624:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787779508.664167:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787779508.851336:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787779509.683098:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855a603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874622524986880:0@lo:400:kworker.0 00000100:00100000:0.0:1787779509.683155:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855a60780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c28aae66-2825-42c5-8f52-61f687e868c9:3305:1874622524986752:0@lo:400:kworker.0 00000100:00100000:1.0:1787779509.683323:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87aa321c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874622524987136:0@lo:400:kworker.0 00000100:00100000:3.0:1787779509.683386:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87aa31a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874622524987008:0@lo:400:kworker.0 00000100:00100000:0.0:1787779509.683449:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779509.683508:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87aa303c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874622524987264:0@lo:400:kworker.0 00000100:00100000:0.0:1787779509.683531:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779509.683892:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779509.683925:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87aa30f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622524987392:0@lo:400:kworker.0 00000100:00100000:2.0:1787779509.683956:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779509.683999:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524986752 00000100:00100000:2.0:1787779509.684019:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524986752 00000100:00100000:2.0:1787779509.684137:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1787779509.684147:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842effc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+19:3305:x1874622524986752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779509.684199:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842effc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+19:3305:x1874622524986752:12345-0@lo:400:kworker.0 Request processed in 53us (750us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779509.684206:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1787779509.684239:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524987264 00000100:00100000:2.0:1787779509.684243:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524987264 00000100:00100000:2.0:1787779509.684396:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524986880 00000100:00100000:2.0:1787779509.684400:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524986880 00000100:00100000:2.0:1787779509.684422:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787779509.684428:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842fee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874622524987264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779509.684461:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842fee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874622524987264:12345-0@lo:400:kworker.0 Request processed in 34us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779509.684467:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787779509.684479:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787779509.684484:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f6b5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874622524986880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779509.684514:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f6b5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874622524986880:12345-0@lo:400:kworker.0 Request processed in 31us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779509.684520:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787779509.684537:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524987392 00000100:00100000:2.0:1787779509.684539:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524987392 00000100:00100000:2.0:1787779509.684566:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787779509.684572:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f6b6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622524987392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779509.684601:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f6b6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622524987392:12345-0@lo:400:kworker.0 Request processed in 29us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779509.684607:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1787779509.684636:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787779509.684640:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787779509.685271:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779509.685431:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524987136 00000100:00100000:0.0:1787779509.685436:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524987136 00000100:00100000:0.0:1787779509.685479:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787779509.685496:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ece43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874622524987136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779509.685544:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ece43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874622524987136:12345-0@lo:400:kworker.0 Request processed in 57us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779509.685549:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1787779509.685584:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e87aa321c0 x1874622524987136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779525 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779509.685598:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87aa321c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874622524987136:0@lo:400:kworker.0 00000100:00100000:2.0:1787779509.686258:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855a60780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c28aae66-2825-42c5-8f52-61f687e868c9:3305:1874622524986752:0@lo:400:kworker.0 00000100:00100000:2.0:1787779509.686435:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87aa303c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874622524987264:0@lo:400:kworker.0 00000100:00100000:2.0:1787779509.686473:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855a603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874622524986880:0@lo:400:kworker.0 00010000:00080000:2.0:1787779509.686489:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e87aa30f00 x1874622524987392/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779525 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779509.686499:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87aa30f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622524987392:0@lo:400:kworker.0 00000100:00100000:3.0:1787779509.688856:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779509.689021:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524987008 00000100:00100000:2.0:1787779509.689031:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524987008 00000100:00080000:1.0:1787779509.689197:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787779509.689214:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787779509.689225:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87aa31680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874622524987008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779509.689307:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87aa31680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874622524987008:12345-0@lo:400:kworker.0 Request processed in 85us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779509.689315:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787779509.689393:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87aa31a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874622524987008:0@lo:400:kworker.0 00010000:00010000:0.0:1787779509.875181:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787779510.196977:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f6b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622524987520:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787779510.197167:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779510.197288:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524987520 00000100:00100000:2.0:1787779510.197295:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524987520 00000100:00100000:2.0:1787779510.197340:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787779510.197349:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f6b4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622524987520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787779510.197388:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787779510.197435:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f6b4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622524987520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779510.197443:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:2.0:1787779510.197569:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e87f6b7480 x1874622524987520/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779526 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779510.197588:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f6b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622524987520:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787779510.442824:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779510.442887:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779510.442934:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779510.442967:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779510.443003:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505033216 00000100:00100000:0.0:1787779510.443013:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505033216 00000100:00100000:0.0:1787779510.443066:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505033344 00000100:00100000:0.0:1787779510.443070:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505033344 00000100:00100000:0.0:1787779510.443090:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 10 00000100:00100000:0.0:1787779510.443099:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec183c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+5:2356:x1874622505033216:12345-192.168.201.9@tcp:9:kworker.0 00000020:00000080:0.0:1787779510.443134:0:6681:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9e63ba8af6888f4b 00000100:00080000:0.0:1787779510.443156:0:6681:0:(import.c:65:import_set_state_nolock()) ffff98e87a9f4000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787779510.443197:0:6681:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1787779510.443523:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec183c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+2:2356:x1874622505033216:12345-192.168.201.9@tcp:9:kworker.0 Request processed in 424us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779510.443532:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 10 00000100:00100000:0.0:1787779510.443550:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 11 00000100:00100000:0.0:1787779510.443557:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec18f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+5:2356:x1874622505033344:12345-192.168.201.9@tcp:9:kworker.0 00000020:00000080:0.0:1787779510.443571:0:6681:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9e63ba8af6888f52 00000100:00080000:0.0:1787779510.443578:0:6681:0:(import.c:65:import_set_state_nolock()) ffff98e87a9f6800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787779510.443600:0:6681:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1787779510.443822:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec18f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+2:2356:x1874622505033344:12345-192.168.201.9@tcp:9:kworker.0 Request processed in 265us (852us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779510.443830:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 11 00000100:00080000:0.0:1787779510.443873:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787779510.443877:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787779510.443934:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779510.444050:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779510.444130:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505032960 00000100:00100000:1.0:1787779510.444135:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505032960 00000100:00100000:1.0:1787779510.444170:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 196 00000100:00100000:1.0:1787779510.444177:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842efdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+10:2357:x1874622505032960:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:1.0:1787779510.444213:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842efdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+10:2357:x1874622505032960:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 36us (1400us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779510.444220:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 196 00000100:00100000:3.0:1787779510.444994:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505033088 00000100:00100000:3.0:1787779510.445001:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505033088 00000100:00100000:3.0:1787779510.445111:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 41 00000100:00100000:3.0:1787779510.445121:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842feed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:2357:x1874622505033088:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:3.0:1787779510.445209:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842feed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:2357:x1874622505033088:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 90us (2321us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779510.445217:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 41 00000100:00080000:0.0:1787779510.446814:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787779510.901447:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779511.923084:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779512.947037:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787779513.012418:0:9042:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg109-server.virtnet: executing yml_node 00000100:00100000:0.0:1787779513.782144:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ece4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874622524987648:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787779513.782223:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779513.785835:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524987648 00000100:00100000:2.0:1787779513.785853:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524987648 00000100:00100000:2.0:1787779513.785931:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787779513.785941:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec19680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874622524987648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787779513.786770:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787779513.787893:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec19680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874622524987648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1945us (5661us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779513.787907:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1787779513.788248:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e87ece4f00 x1874622524987648/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779529 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779513.788275:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ece4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874622524987648:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787779513.791930:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:0.0:1787779513.900412:0:6704:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e225400f-8d32-48a8-ab5e-fe4d3780a20c 00000020:00000080:0.0:1787779513.900422:0:6704:0:(genops.c:885:class_export_put()) final put ffff98e87a9f7000/e225400f-8d32-48a8-ab5e-fe4d3780a20c 00000020:00000080:0.0:1787779513.900452:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98e87a9f7000/e225400f-8d32-48a8-ab5e-fe4d3780a20c for lustre-OST0000 00000020:00000080:0.0:1787779513.900499:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98e87a9f4000 for lustre-OST0000 00010000:00010000:1.0:1787779513.973474:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787779514.376542:0:7634:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e225400f-8d32-48a8-ab5e-fe4d3780a20c 00000020:00000080:0.0:1787779514.376552:0:7634:0:(genops.c:885:class_export_put()) final put ffff98e87a9f4800/e225400f-8d32-48a8-ab5e-fe4d3780a20c 00000020:00000080:1.0:1787779514.377092:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98e87a9f4800/e225400f-8d32-48a8-ab5e-fe4d3780a20c for lustre-OST0001 00000020:00000080:1.0:1787779514.377150:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98e87a9f6800 for lustre-OST0001 00000100:00100000:2.0:1787779514.804052:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855a60780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874622524988032:0@lo:400:kworker.0 00000100:00100000:2.0:1787779514.804168:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779514.804239:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787779514.804246:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855a603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874622524987904:0@lo:400:kworker.0 00000100:00100000:2.0:1787779514.804269:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779514.804285:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f61ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622524988416:0@lo:400:kworker.0 00000100:00100000:2.0:1787779514.804306:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779514.804339:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524988032 00000100:00100000:2.0:1787779514.804346:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524988032 00000100:00100000:2.0:1787779514.804392:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524987904 00000100:00100000:2.0:1787779514.804394:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524987904 00000100:00100000:2.0:1787779514.804412:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787779514.804420:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f61e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874622524988032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779514.804469:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f61e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874622524988032:12345-0@lo:400:kworker.0 Request processed in 49us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779514.804484:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787779514.804502:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787779514.804507:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f61de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874622524987904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779514.804536:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f61de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874622524987904:12345-0@lo:400:kworker.0 Request processed in 29us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779514.804542:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787779514.804562:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524988416 00000100:00100000:2.0:1787779514.804565:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524988416 00000100:00100000:0.0:1787779514.804694:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f61c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874622524988160:0@lo:400:kworker.0 00000100:00100000:0.0:1787779514.804755:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779514.804810:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f6b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c28aae66-2825-42c5-8f52-61f687e868c9:3305:1874622524987776:0@lo:400:kworker.0 00000100:00100000:1.0:1787779514.804844:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779514.807077:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524988160 00000100:00100000:0.0:1787779514.807091:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524988160 00000100:00100000:0.0:1787779514.807135:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787779514.807146:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f61fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622524988416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779514.807215:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f61fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622524988416:12345-0@lo:400:kworker.0 Request processed in 72us (2907us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779514.807222:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787779514.807237:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787779514.807257:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec192c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874622524988160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779514.807293:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec192c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874622524988160:12345-0@lo:400:kworker.0 Request processed in 38us (2538us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779514.807299:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1787779514.807337:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e87f61c780 x1874622524988160/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779530 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779514.807352:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f61c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874622524988160:0@lo:400:kworker.0 00000100:00100000:1.0:1787779514.808953:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f61c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874622524988288:0@lo:400:kworker.0 00000100:00100000:1.0:1787779514.809004:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779514.809068:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524988288 00000100:00100000:1.0:1787779514.809073:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524988288 00000100:00100000:1.0:1787779514.809119:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787779514.809127:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ece5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874622524988288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779514.809172:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ece5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874622524988288:12345-0@lo:400:kworker.0 Request processed in 45us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779514.809178:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:1.0:1787779514.809199:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787779514.809204:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787779514.809224:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f61c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874622524988288:0@lo:400:kworker.0 00000100:00100000:1.0:1787779514.809249:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855a603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874622524987904:0@lo:400:kworker.0 00010000:00080000:1.0:1787779514.809263:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e87f61ed00 x1874622524988416/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779530 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779514.809273:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f61ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622524988416:0@lo:400:kworker.0 00000100:00100000:1.0:1787779514.809285:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855a60780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874622524988032:0@lo:400:kworker.0 00000100:00100000:1.0:1787779514.809315:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524987776 00000100:00100000:1.0:1787779514.809318:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524987776 00000100:00100000:1.0:1787779514.809340:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1787779514.809345:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842efc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+19:3305:x1874622524987776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779514.809374:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842efc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+19:3305:x1874622524987776:12345-0@lo:400:kworker.0 Request processed in 29us (4530us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779514.809380:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1787779514.809412:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f6b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c28aae66-2825-42c5-8f52-61f687e868c9:3305:1874622524987776:0@lo:400:kworker.0 00010000:00010000:2.0:1787779514.995017:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779515.315081:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787779515.315109:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f61cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622524988544:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787779515.315211:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779515.315344:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524988544 00000100:00100000:2.0:1787779515.315355:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524988544 00000100:00100000:2.0:1787779515.315416:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787779515.315427:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87aa312c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622524988544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787779515.315493:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787779515.315549:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87aa312c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622524988544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779515.315557:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:3.0:1787779515.315970:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e87f61cb40 x1874622524988544/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779531 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779515.316001:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f61cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622524988544:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787779515.553645:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779515.555769:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505033472 00000100:00100000:1.0:1787779515.555796:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505033472 00000100:00100000:1.0:1787779515.555886:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 198 00000100:00100000:1.0:1787779515.555898:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842efcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+10:2359:x1874622505033472:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:1.0:1787779515.555987:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842efcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+10:2359:x1874622505033472:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 90us (2352us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779515.555995:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 198 00000100:00100000:0.0:1787779515.556577:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779515.557565:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505033600 00000100:00100000:1.0:1787779515.557575:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505033600 00000100:00100000:1.0:1787779515.557654:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 45 00000100:00100000:1.0:1787779515.557664:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec1a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:2359:x1874622505033600:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:1.0:1787779515.557763:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec1a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:2359:x1874622505033600:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 100us (1187us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779515.557780:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 45 00000100:00080000:3.0:1787779515.557903:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787779516.024446:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779517.049539:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787779517.309314:0:9235:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.57 00010000:00010000:1.0:1787779518.067025:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779518.899321:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787779518.899349:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ece4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874622524988672:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787779518.899431:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779518.900475:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524988672 00000100:00100000:1.0:1787779518.900487:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524988672 00000100:00100000:1.0:1787779518.900565:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787779518.900577:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87aa32940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874622524988672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787779518.900620:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787779518.900747:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87aa32940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874622524988672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 138us (1282us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779518.900754:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:3.0:1787779518.900836:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787779518.900914:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e87ece4f00 x1874622524988672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779534 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779518.900935:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ece4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874622524988672:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787779519.091288:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787779519.922982:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787779519.923009:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f61e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c28aae66-2825-42c5-8f52-61f687e868c9:3304:1874622524988800:0@lo:400:kworker.0 00000100:00100000:2.0:1787779519.923108:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779519.923196:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787779519.923207:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f61c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874622524988928:0@lo:400:kworker.0 00000100:00100000:2.0:1787779519.923248:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779519.923291:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f61d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874622524989056:0@lo:400:kworker.0 00000100:00100000:2.0:1787779519.923316:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779519.923352:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524988928 00000100:00100000:2.0:1787779519.923360:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524988928 00000100:00100000:2.0:1787779519.923575:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524989056 00000100:00100000:2.0:1787779519.923579:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524989056 00000100:00100000:2.0:1787779519.923615:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787779519.923624:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f61cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874622524988928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779519.923738:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787779519.923748:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f61d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874622524989056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779519.923805:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f61d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874622524989056:12345-0@lo:400:kworker.0 Request processed in 59us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779519.923812:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:3.0:1787779519.923837:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787779519.923868:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f61d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874622524989056:0@lo:400:kworker.0 00000100:00100000:2.0:1787779519.923971:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f61cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874622524988928:12345-0@lo:400:kworker.0 Request processed in 347us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779519.923978:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787779519.924023:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f61e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874622524989184:0@lo:400:kworker.0 00000100:00100000:2.0:1787779519.924055:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779519.924095:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524989184 00000100:00100000:2.0:1787779519.924099:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524989184 00000100:00100000:2.0:1787779519.924130:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787779519.924137:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f61f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874622524989184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779519.924173:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f61f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874622524989184:12345-0@lo:400:kworker.0 Request processed in 36us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779519.924179:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1787779519.924212:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e87f61e940 x1874622524989184/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779535 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779519.924226:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f61e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874622524989184:0@lo:400:kworker.0 00000100:00100000:2.0:1787779519.924256:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787779519.924263:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f61e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874622524989312:0@lo:400:kworker.0 00000100:00100000:2.0:1787779519.924299:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779519.924415:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f61d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622524989440:0@lo:400:kworker.0 00000100:00100000:3.0:1787779519.924445:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779519.924484:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524989312 00000100:00100000:3.0:1787779519.924488:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524989312 00000100:00100000:3.0:1787779519.924520:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787779519.924525:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f61f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874622524989312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779519.924558:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f61f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874622524989312:12345-0@lo:400:kworker.0 Request processed in 33us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779519.924574:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:3.0:1787779519.924589:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787779519.924608:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f61c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874622524988928:0@lo:400:kworker.0 00000100:00100000:3.0:1787779519.924632:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f61e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874622524989312:0@lo:400:kworker.0 00000100:00100000:1.0:1787779519.924927:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524988800 00000100:00100000:1.0:1787779519.924932:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524988800 00000100:00100000:1.0:1787779519.924974:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1787779519.924982:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842eff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+19:3304:x1874622524988800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779519.925031:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842eff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+19:3304:x1874622524988800:12345-0@lo:400:kworker.0 Request processed in 50us (1924us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779519.925038:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1787779519.925776:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524989440 00000100:00100000:2.0:1787779519.925785:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524989440 00000100:00100000:2.0:1787779519.925835:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787779519.925844:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87aa33840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622524989440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779519.925895:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87aa33840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622524989440:12345-0@lo:400:kworker.0 Request processed in 53us (1449us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779519.925902:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1787779519.927812:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787779519.927868:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e87f61d680 x1874622524989440/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779535 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779519.927886:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f61d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622524989440:0@lo:400:kworker.0 00000100:00100000:3.0:1787779519.927930:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f61e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c28aae66-2825-42c5-8f52-61f687e868c9:3304:1874622524988800:0@lo:400:kworker.0 00010000:00010000:1.0:1787779520.118831:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787779520.387002:0:9333:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.57 00000100:00100000:3.0:1787779520.435867:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787779520.435890:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87aa30780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622524989568:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787779520.435965:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779520.436032:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524989568 00000100:00100000:3.0:1787779520.436040:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524989568 00000100:00100000:3.0:1787779520.436088:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787779520.436096:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87aa30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622524989568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787779520.436132:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787779520.436176:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87aa30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622524989568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779520.436184:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1787779520.436219:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e87aa30780 x1874622524989568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779536 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779520.436236:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87aa30780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622524989568:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787779520.680122:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779520.680171:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779520.680203:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505033728 00000100:00100000:0.0:1787779520.680212:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505033728 00000100:00100000:0.0:1787779520.680256:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 200 00000100:00100000:0.0:1787779520.680265:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842eff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+10:2358:x1874622505033728:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:0.0:1787779520.680330:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842eff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+10:2358:x1874622505033728:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 66us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779520.680338:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 200 00000100:00100000:2.0:1787779520.682883:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505033856 00000100:00100000:2.0:1787779520.682899:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505033856 00000100:00100000:2.0:1787779520.683028:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 49 00000100:00100000:2.0:1787779520.683038:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:2358:x1874622505033856:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:2.0:1787779520.683127:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:2358:x1874622505033856:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 91us (3015us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779520.683135:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 49 00000100:00080000:0.0:1787779520.683336:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787779521.138919:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779522.163194:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779523.188064:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787779523.598187:0:9430:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.57 00000100:00100000:0.0:1787779524.019395:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787779524.019420:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ece4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874622524989696:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787779524.019539:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779524.019735:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524989696 00000100:00100000:1.0:1787779524.019742:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524989696 00000100:00100000:1.0:1787779524.019806:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787779524.019816:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec1a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874622524989696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787779524.019851:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787779524.019901:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec1a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874622524989696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779524.019909:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1787779524.019949:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e87ece4f00 x1874622524989696/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779540 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779524.019968:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ece4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874622524989696:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787779524.020176:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787779524.213452:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779525.043401:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855a603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874622524990208:0@lo:400:kworker.0 00000100:00100000:1.0:1787779525.043474:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779525.043530:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787779525.043537:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ece4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c28aae66-2825-42c5-8f52-61f687e868c9:3304:1874622524989824:0@lo:400:kworker.0 00000100:00100000:1.0:1787779525.043567:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779525.043600:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87a70b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874622524990336:0@lo:400:kworker.0 00000100:00100000:1.0:1787779525.043642:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779525.043670:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f6b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874622524989952:0@lo:400:kworker.0 00000100:00100000:1.0:1787779525.043695:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779525.043744:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87a709a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622524990464:0@lo:400:kworker.0 00000100:00100000:1.0:1787779525.043770:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779525.043789:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787779525.043795:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855a60780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874622524990080:0@lo:400:kworker.0 00000100:00100000:1.0:1787779525.043816:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779525.043843:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524990208 00000100:00100000:1.0:1787779525.043851:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524990208 00000100:00100000:1.0:1787779525.043893:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524990464 00000100:00100000:1.0:1787779525.043896:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524990464 00000100:00100000:1.0:1787779525.043921:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787779525.043930:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a708b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874622524990208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779525.043982:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a708b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874622524990208:12345-0@lo:400:kworker.0 Request processed in 53us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779525.043989:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787779525.044007:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787779525.044013:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e852110f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622524990464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779525.044042:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e852110f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622524990464:12345-0@lo:400:kworker.0 Request processed in 30us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779525.044047:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787779525.044064:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524989824 00000100:00100000:1.0:1787779525.044067:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524989824 00000100:00100000:1.0:1787779525.044104:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1787779525.044111:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842efe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+19:3304:x1874622524989824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779525.044149:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842efe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+19:3304:x1874622524989824:12345-0@lo:400:kworker.0 Request processed in 39us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779525.044156:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1787779525.044179:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524990336 00000100:00100000:1.0:1787779525.044183:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524990336 00000100:00100000:1.0:1787779525.044207:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524989952 00000100:00100000:1.0:1787779525.044211:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524989952 00000100:00100000:1.0:1787779525.044222:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524990080 00000100:00100000:1.0:1787779525.044224:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524990080 00000100:00100000:1.0:1787779525.044237:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787779525.044243:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e855b00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874622524990336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779525.044272:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e855b00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874622524990336:12345-0@lo:400:kworker.0 Request processed in 29us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779525.044278:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787779525.044289:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787779525.044295:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e855b03c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874622524989952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779525.044319:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e855b03c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874622524989952:12345-0@lo:400:kworker.0 Request processed in 25us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779525.044325:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787779525.044335:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787779525.044340:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e852111e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874622524990080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779525.044365:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e852111e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874622524990080:12345-0@lo:400:kworker.0 Request processed in 25us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779525.044371:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:1.0:1787779525.044395:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787779525.044399:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787779525.044420:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ece4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c28aae66-2825-42c5-8f52-61f687e868c9:3304:1874622524989824:0@lo:400:kworker.0 00000100:00100000:1.0:1787779525.044438:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87a70b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874622524990336:0@lo:400:kworker.0 00010000:00080000:1.0:1787779525.044449:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e855a603c0 x1874622524990208/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779541 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779525.044459:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855a603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874622524990208:0@lo:400:kworker.0 00000100:00100000:1.0:1787779525.044487:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855a60780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874622524990080:0@lo:400:kworker.0 00000100:00100000:1.0:1787779525.044495:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f6b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874622524989952:0@lo:400:kworker.0 00010000:00080000:1.0:1787779525.044504:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e87a709a40 x1874622524990464/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779541 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779525.044512:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87a709a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622524990464:0@lo:400:kworker.0 00010000:00010000:1.0:1787779525.234904:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787779525.291239:0:9480:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Wed Aug 26 17:25:23 EDT 2026 00000100:00100000:3.0:1787779525.556081:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787779525.556157:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87aa32580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622524990592:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787779525.556226:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779525.556296:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524990592 00000100:00100000:3.0:1787779525.556306:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524990592 00000100:00100000:3.0:1787779525.556358:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787779525.556367:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87aa31e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622524990592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787779525.556403:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787779525.556460:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87aa31e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622524990592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779525.556468:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1787779525.556505:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e87aa32580 x1874622524990592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779541 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779525.556522:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87aa32580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622524990592:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787779525.791704:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779525.791782:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779525.791890:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505033984 00000100:00100000:1.0:1787779525.791900:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505033984 00000100:00100000:1.0:1787779525.791961:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 202 00000100:00100000:1.0:1787779525.791971:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842efd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+10:2359:x1874622505033984:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:1.0:1787779525.792059:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842efd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+10:2359:x1874622505033984:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 89us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779525.792077:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 202 00000100:00100000:3.0:1787779525.792252:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505034112 00000100:00100000:3.0:1787779525.792258:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505034112 00000100:00100000:3.0:1787779525.792308:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 53 00000100:00100000:3.0:1787779525.792316:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec19e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:2359:x1874622505034112:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:3.0:1787779525.792350:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec19e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:2359:x1874622505034112:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 35us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779525.792356:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 53 00000100:00080000:1.0:1787779525.792463:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787779526.258957:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779527.292035:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779528.310693:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779529.139637:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787779529.139660:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ec1bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874622524990720:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787779529.139759:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779529.139827:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524990720 00000100:00100000:0.0:1787779529.139835:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524990720 00000100:00100000:0.0:1787779529.139887:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787779529.139897:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec18b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874622524990720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787779529.139937:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787779529.139984:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec18b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874622524990720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779529.139992:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1787779529.140047:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e87ec1bc00 x1874622524990720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779545 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779529.140064:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ec1bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874622524990720:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787779529.141731:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787779529.351258:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779530.169814:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ec1a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874622524991232:0@lo:400:kworker.0 00000100:00100000:0.0:1787779530.169892:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779530.169950:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787779530.169957:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ec1bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c28aae66-2825-42c5-8f52-61f687e868c9:3304:1874622524990848:0@lo:400:kworker.0 00000100:00100000:0.0:1787779530.169986:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779530.170008:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ec1ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874622524991360:0@lo:400:kworker.0 00000100:00100000:0.0:1787779530.170068:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779530.170095:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ec1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874622524990976:0@lo:400:kworker.0 00000100:00100000:0.0:1787779530.170119:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779530.170147:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ec18780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622524991488:0@lo:400:kworker.0 00000100:00100000:0.0:1787779530.170174:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779530.170208:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787779530.170214:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ec19a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874622524991104:0@lo:400:kworker.0 00000100:00100000:0.0:1787779530.170247:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779530.170291:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524991232 00000100:00100000:0.0:1787779530.170297:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524991232 00000100:00100000:0.0:1787779530.170336:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524991488 00000100:00100000:0.0:1787779530.170340:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524991488 00000100:00100000:0.0:1787779530.170364:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787779530.170373:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec1b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874622524991232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779530.170424:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec1b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874622524991232:12345-0@lo:400:kworker.0 Request processed in 52us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779530.170431:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787779530.170449:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787779530.170456:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842fef0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622524991488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779530.170811:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524991360 00000100:00100000:1.0:1787779530.170816:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524991360 00000100:00100000:1.0:1787779530.170846:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524990976 00000100:00100000:1.0:1787779530.170854:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524990976 00000100:00100000:1.0:1787779530.170868:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524991104 00000100:00100000:1.0:1787779530.170869:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524991104 00000100:00100000:1.0:1787779530.170882:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787779530.170888:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec1b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874622524991360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779530.170923:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec1b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874622524991360:12345-0@lo:400:kworker.0 Request processed in 35us (855us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779530.170929:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787779530.170942:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787779530.170948:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842fed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874622524990976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779530.170978:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842fed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874622524990976:12345-0@lo:400:kworker.0 Request processed in 31us (858us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779530.170984:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787779530.170996:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787779530.171002:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87fd2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874622524991104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779530.171027:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87fd2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874622524991104:12345-0@lo:400:kworker.0 Request processed in 25us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779530.171032:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787779530.171058:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524990848 00000100:00100000:1.0:1787779530.171061:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524990848 00000100:00100000:1.0:1787779530.171081:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1787779530.171087:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842efe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+19:3304:x1874622524990848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779530.171112:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842efe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+19:3304:x1874622524990848:12345-0@lo:400:kworker.0 Request processed in 25us (1126us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779530.171118:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1787779530.171246:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842fef0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622524991488:12345-0@lo:400:kworker.0 Request processed in 791us (1071us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779530.171253:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:0.0:1787779530.171270:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787779530.171274:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787779530.171296:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ec1bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c28aae66-2825-42c5-8f52-61f687e868c9:3304:1874622524990848:0@lo:400:kworker.0 00000100:00100000:0.0:1787779530.171307:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ec1ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874622524991360:0@lo:400:kworker.0 00010000:00080000:0.0:1787779530.171317:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e87ec1a1c0 x1874622524991232/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779546 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779530.171327:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ec1a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874622524991232:0@lo:400:kworker.0 00000100:00100000:0.0:1787779530.171351:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ec19a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874622524991104:0@lo:400:kworker.0 00000100:00100000:0.0:1787779530.171369:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ec1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874622524990976:0@lo:400:kworker.0 00010000:00080000:0.0:1787779530.171376:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e87ec18780 x1874622524991488/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779546 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779530.171385:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ec18780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622524991488:0@lo:400:kworker.0 00010000:00010000:2.0:1787779530.367823:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779530.674958:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787779530.674984:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87aa33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622524991616:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787779530.675072:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779530.675356:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524991616 00000100:00100000:3.0:1787779530.675364:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524991616 00000100:00100000:3.0:1787779530.675430:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787779530.675448:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e852113480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622524991616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787779530.675494:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787779530.675557:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e852113480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622524991616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779530.675565:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:1.0:1787779530.675875:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e87aa33480 x1874622524991616/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779546 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779530.675893:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87aa33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622524991616:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787779530.918048:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779530.918162:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779530.918230:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505034240 00000100:00100000:1.0:1787779530.918239:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505034240 00000100:00100000:1.0:1787779530.918299:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 204 00000100:00100000:1.0:1787779530.918309:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842efd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+10:2357:x1874622505034240:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:1.0:1787779530.918389:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842efd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+10:2357:x1874622505034240:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 81us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779530.918398:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 204 00000100:00100000:3.0:1787779530.919089:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505034368 00000100:00100000:3.0:1787779530.919097:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505034368 00000100:00100000:3.0:1787779530.919165:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 57 00000100:00100000:3.0:1787779530.919173:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f61ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:2357:x1874622505034368:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:3.0:1787779530.919230:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f61ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:2357:x1874622505034368:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 58us (1068us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779530.919238:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 57 00000100:00080000:0.0:1787779530.919494:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787779531.378950:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787779532.405699:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779533.427041:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779534.266459:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87aa30b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874622524991744:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787779534.266541:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779534.266736:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524991744 00000100:00100000:3.0:1787779534.266744:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524991744 00000100:00100000:3.0:1787779534.266798:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787779534.266809:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87fd283c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874622524991744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787779534.266843:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787779534.266931:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87fd283c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874622524991744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779534.266940:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1787779534.268425:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787779534.268489:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e87aa30b40 x1874622524991744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779550 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779534.268514:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87aa30b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874622524991744:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787779534.453419:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779535.284008:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87fd292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874622524992128:0@lo:400:kworker.0 00000100:00100000:0.0:1787779535.284112:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779535.284142:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87fd29680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874622524992000:0@lo:400:kworker.0 00000100:00100000:3.0:1787779535.284191:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779535.284218:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87fd2b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622524992512:0@lo:400:kworker.0 00000100:00100000:1.0:1787779535.284264:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87fd28f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c28aae66-2825-42c5-8f52-61f687e868c9:3305:1874622524991872:0@lo:400:kworker.0 00000100:00100000:1.0:1787779535.284307:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779535.284340:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87fd2b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874622524992384:0@lo:400:kworker.0 00000100:00100000:1.0:1787779535.284367:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779535.284392:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787779535.284397:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87fd2a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874622524992256:0@lo:400:kworker.0 00000100:00100000:1.0:1787779535.284448:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524992128 00000100:00100000:1.0:1787779535.284456:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524992128 00000100:00100000:0.0:1787779535.285635:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524991872 00000100:00100000:0.0:1787779535.285651:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524991872 00000100:00100000:1.0:1787779535.285748:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524992000 00000100:00100000:0.0:1787779535.285758:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1787779535.285770:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524992000 00000100:00100000:0.0:1787779535.285777:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842efc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+19:3305:x1874622524991872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779535.285809:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524992384 00000100:00100000:1.0:1787779535.285816:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524992384 00000100:00100000:0.0:1787779535.285907:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842efc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+19:3305:x1874622524991872:12345-0@lo:400:kworker.0 Request processed in 135us (1597us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779535.285916:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1787779535.286927:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779535.289474:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779535.289603:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87fd28f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c28aae66-2825-42c5-8f52-61f687e868c9:3305:1874622524991872:0@lo:400:kworker.0 00000100:00100000:0.0:1787779535.289942:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787779535.289959:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87fd28780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874622524992128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779535.290059:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87fd28780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874622524992128:12345-0@lo:400:kworker.0 Request processed in 108us (5947us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779535.290067:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787779535.290105:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787779535.290113:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87aa33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874622524992000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779535.290149:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87aa33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874622524992000:12345-0@lo:400:kworker.0 Request processed in 38us (5960us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779535.290155:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787779535.290203:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87fd292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874622524992128:0@lo:400:kworker.0 00000100:00080000:2.0:1787779535.290413:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787779535.290860:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87fd29680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874622524992000:0@lo:400:kworker.0 00000100:00100000:1.0:1787779535.291086:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787779535.291093:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f6b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874622524992384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779535.291155:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f6b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874622524992384:12345-0@lo:400:kworker.0 Request processed in 62us (6787us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779535.291161:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787779535.291195:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87fd2b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874622524992384:0@lo:400:kworker.0 00000100:00100000:3.0:1787779535.291340:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524992512 00000100:00100000:3.0:1787779535.291348:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524992512 00000100:00080000:2.0:1787779535.292308:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787779535.296391:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524992256 00000100:00100000:1.0:1787779535.296406:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524992256 00000100:00100000:1.0:1787779535.296471:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787779535.296481:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87fd28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874622524992256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779535.297081:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87fd28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874622524992256:12345-0@lo:400:kworker.0 Request processed in 598us (7612us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779535.297090:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:0.0:1787779535.297249:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e87fd2a940 x1874622524992256/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779551 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779535.297266:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87fd2a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874622524992256:0@lo:400:kworker.0 00000100:00100000:3.0:1787779535.297412:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787779535.297422:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87aa33c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622524992512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779535.297485:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87aa33c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622524992512:12345-0@lo:400:kworker.0 Request processed in 66us (10564us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779535.297492:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1787779535.299652:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e87fd2b0c0 x1874622524992512/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779551 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779535.299679:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87fd2b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622524992512:0@lo:400:kworker.0 00010000:00010000:2.0:1787779535.486488:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779535.797235:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87aa32580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622524992640:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787779535.797335:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779535.797847:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524992640 00000100:00100000:3.0:1787779535.797858:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524992640 00000100:00100000:3.0:1787779535.797926:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787779535.797937:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e855a603c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622524992640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787779535.797985:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787779535.798059:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e855a603c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622524992640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779535.798066:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1787779535.798162:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e87aa32580 x1874622524992640/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779551 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779535.798184:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87aa32580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622524992640:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787779536.039169:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779536.039244:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779536.039662:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505034624 00000100:00100000:0.0:1787779536.039675:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505034624 00000100:00100000:0.0:1787779536.039824:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 61 00000100:00100000:0.0:1787779536.039838:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f61c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:2357:x1874622505034624:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:0.0:1787779536.039957:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f61c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:2357:x1874622505034624:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 123us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779536.039966:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 61 00000100:00100000:1.0:1787779536.040486:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505034496 00000100:00100000:1.0:1787779536.040494:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505034496 00000100:00100000:1.0:1787779536.040545:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 206 00000100:00100000:1.0:1787779536.040554:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842eff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+10:2357:x1874622505034496:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:1.0:1787779536.040603:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842eff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+10:2357:x1874622505034496:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 50us (1453us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779536.040611:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 206 00000100:00080000:2.0:1787779536.040775:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787779536.500146:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779537.523984:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779538.551194:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779539.379512:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787779539.379545:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87fd292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874622524992768:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787779539.379614:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779539.379692:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524992768 00000100:00100000:0.0:1787779539.379742:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524992768 00000100:00100000:0.0:1787779539.379803:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787779539.379814:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87fd28f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874622524992768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787779539.379853:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787779539.379903:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87fd28f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874622524992768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779539.379910:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1787779539.379941:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787779539.381230:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e87fd292c0 x1874622524992768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779555 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779539.381261:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87fd292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874622524992768:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787779539.571127:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779540.403092:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87fd2a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874622524993024:0@lo:400:kworker.0 00000100:00100000:0.0:1787779540.403166:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779540.403220:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87fd292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622524993536:0@lo:400:kworker.0 00000100:00100000:0.0:1787779540.403246:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779540.403277:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787779540.403284:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87fd29e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874622524993152:0@lo:400:kworker.0 00000100:00100000:3.0:1787779540.403453:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87fd2bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874622524993280:0@lo:400:kworker.0 00000100:00100000:3.0:1787779540.403486:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779540.403513:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787779540.403518:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87fd2ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c28aae66-2825-42c5-8f52-61f687e868c9:3304:1874622524992896:0@lo:400:kworker.0 00000100:00100000:3.0:1787779540.403543:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779540.403562:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87fd28b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874622524993408:0@lo:400:kworker.0 00000100:00100000:3.0:1787779540.403582:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779540.403610:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524993536 00000100:00100000:3.0:1787779540.403618:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524993536 00000100:00100000:3.0:1787779540.403683:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524993280 00000100:00100000:3.0:1787779540.403698:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524993280 00000100:00100000:3.0:1787779540.403740:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787779540.403749:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87fd2b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622524993536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779540.403803:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87fd2b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622524993536:12345-0@lo:400:kworker.0 Request processed in 55us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779540.403811:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787779540.403830:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787779540.403836:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87aa330c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874622524993280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779540.403870:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87aa330c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874622524993280:12345-0@lo:400:kworker.0 Request processed in 34us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779540.403876:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1787779540.403906:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e87fd2bc00 x1874622524993280/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779556 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779540.403920:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87fd2bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874622524993280:0@lo:400:kworker.0 00000100:00100000:0.0:1787779540.404276:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787779540.404445:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e87fd292c0 x1874622524993536/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779556 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779540.404456:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87fd292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622524993536:0@lo:400:kworker.0 00000100:00080000:0.0:1787779540.404476:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787779540.411961:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524993024 00000100:00100000:2.0:1787779540.411976:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524993024 00000100:00100000:2.0:1787779540.412145:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524993408 00000100:00100000:2.0:1787779540.412150:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524993408 00000100:00100000:2.0:1787779540.412177:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524993152 00000100:00100000:2.0:1787779540.412180:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524993152 00000100:00100000:2.0:1787779540.412201:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787779540.412211:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87fd2a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874622524993024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779540.412370:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787779540.412383:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87aa31a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874622524993408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779540.412465:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87aa31a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874622524993408:12345-0@lo:400:kworker.0 Request processed in 87us (8881us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779540.412472:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787779540.412493:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787779540.412500:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87fd2b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874622524993152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779540.412547:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87fd2b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874622524993152:12345-0@lo:400:kworker.0 Request processed in 49us (8272us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779540.412554:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787779540.412598:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87fd29e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874622524993152:0@lo:400:kworker.0 00000100:00100000:1.0:1787779540.412924:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524992896 00000100:00100000:1.0:1787779540.412929:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524992896 00000100:00100000:1.0:1787779540.412958:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1787779540.412964:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842efe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+19:3304:x1874622524992896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779540.412999:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842efe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+19:3304:x1874622524992896:12345-0@lo:400:kworker.0 Request processed in 36us (9455us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779540.413018:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1787779540.413199:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87fd2a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874622524993024:12345-0@lo:400:kworker.0 Request processed in 988us (10031us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779540.413205:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:2.0:1787779540.413225:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787779540.419026:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87fd2ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c28aae66-2825-42c5-8f52-61f687e868c9:3304:1874622524992896:0@lo:400:kworker.0 00000100:00100000:3.0:1787779540.419053:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87fd28b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874622524993408:0@lo:400:kworker.0 00000100:00100000:1.0:1787779540.427469:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87fd2a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874622524993024:0@lo:400:kworker.0 00010000:00010000:3.0:1787779540.596823:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779540.916801:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87fd292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622524993664:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787779540.916881:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779540.918102:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524993664 00000100:00100000:0.0:1787779540.918111:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524993664 00000100:00100000:0.0:1787779540.918162:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787779540.918172:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e855a60780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622524993664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787779540.918215:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787779540.918278:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e855a60780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622524993664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (1398us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779540.918285:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1787779540.918341:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e87fd292c0 x1874622524993664/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779556 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779540.918362:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87fd292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622524993664:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787779541.159147:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779541.159196:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779541.159290:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505034752 00000100:00100000:0.0:1787779541.159299:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505034752 00000100:00100000:0.0:1787779541.159363:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 208 00000100:00100000:0.0:1787779541.159373:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842efec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+10:2358:x1874622505034752:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:0.0:1787779541.159444:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842efec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+10:2358:x1874622505034752:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 72us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779541.159452:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 208 00000100:00100000:1.0:1787779541.159858:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505034880 00000100:00100000:1.0:1787779541.159863:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505034880 00000100:00100000:1.0:1787779541.159911:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 65 00000100:00100000:1.0:1787779541.159920:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f61cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:2358:x1874622505034880:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:1.0:1787779541.159971:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f61cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:2358:x1874622505034880:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 53us (834us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779541.159979:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 65 00000100:00080000:0.0:1787779541.160057:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787779541.620858:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787779542.644332:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787779543.673055:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787779544.503583:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787779544.503607:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f61f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874622524993792:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787779544.503679:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779544.503785:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524993792 00000100:00100000:2.0:1787779544.503794:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524993792 00000100:00100000:2.0:1787779544.503853:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787779544.503863:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f61da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874622524993792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787779544.503898:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787779544.503959:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f61da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874622524993792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779544.503966:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:2.0:1787779544.503989:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787779544.504019:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e87f61f480 x1874622524993792/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779560 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779544.504036:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f61f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874622524993792:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787779544.692787:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779545.525877:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87a709a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c28aae66-2825-42c5-8f52-61f687e868c9:3305:1874622524993920:0@lo:400:kworker.0 00000100:00100000:3.0:1787779545.525962:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779545.526095:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524993920 00000100:00100000:0.0:1787779545.526104:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524993920 00000100:00100000:0.0:1787779545.526165:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1787779545.526174:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842efc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+19:3305:x1874622524993920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779545.526390:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87a70b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874622524994048:0@lo:400:kworker.0 00000100:00100000:1.0:1787779545.526437:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779545.526480:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524994048 00000100:00100000:1.0:1787779545.526484:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524994048 00000100:00100000:1.0:1787779545.526514:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787779545.526522:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ece4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874622524994048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779545.526561:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ece4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874622524994048:12345-0@lo:400:kworker.0 Request processed in 40us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779545.526568:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787779545.526609:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87a70b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874622524994048:0@lo:400:kworker.0 00000100:00100000:1.0:1787779545.526645:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787779545.526651:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87a70b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874622524994176:0@lo:400:kworker.0 00000100:00100000:1.0:1787779545.526697:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779545.526754:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524994176 00000100:00100000:1.0:1787779545.526758:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524994176 00000100:00100000:1.0:1787779545.526791:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787779545.526797:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f538000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874622524994176:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787779545.527266:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787779545.529267:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f538000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874622524994176:12345-0@lo:400:kworker.0 Request processed in 2461us (2560us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779545.529281:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787779545.529450:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87a70b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874622524994176:0@lo:400:kworker.0 00000100:00100000:2.0:1787779545.529573:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f53ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874622524994304:0@lo:400:kworker.0 00000100:00100000:2.0:1787779545.529622:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779545.529670:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524994304 00000100:00100000:2.0:1787779545.529676:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524994304 00000100:00100000:2.0:1787779545.529744:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787779545.529753:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f61f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874622524994304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779545.529806:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f61f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874622524994304:12345-0@lo:400:kworker.0 Request processed in 54us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779545.529812:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:2.0:1787779545.532026:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e87f53ad00 x1874622524994304/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779561 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779545.532054:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f53ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874622524994304:0@lo:400:kworker.0 00000100:00100000:0.0:1787779545.533671:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842efc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+19:3305:x1874622524993920:12345-0@lo:400:kworker.0 Request processed in 7489us (7700us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779545.533688:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1787779545.535563:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787779545.535590:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f539e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622524994560:0@lo:400:kworker.0 00000100:00100000:1.0:1787779545.535676:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779545.535989:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787779545.536000:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f53a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874622524994432:0@lo:400:kworker.0 00000100:00100000:2.0:1787779545.536036:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779545.536185:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524994560 00000100:00100000:0.0:1787779545.536193:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524994560 00000100:00100000:0.0:1787779545.536268:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787779545.536278:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f53bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622524994560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779545.536342:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f53bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622524994560:12345-0@lo:400:kworker.0 Request processed in 66us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779545.536350:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:2.0:1787779545.536569:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787779545.536630:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524994432 00000100:00100000:1.0:1787779545.536635:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524994432 00000100:00100000:1.0:1787779545.536689:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787779545.536698:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f61e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874622524994432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779545.536780:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f61e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874622524994432:12345-0@lo:400:kworker.0 Request processed in 84us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779545.536787:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:1.0:1787779545.536966:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e87f539e00 x1874622524994560/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779561 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779545.536980:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f539e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622524994560:0@lo:400:kworker.0 00000100:00100000:1.0:1787779545.537013:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f53a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874622524994432:0@lo:400:kworker.0 00000100:00080000:2.0:1787779545.537231:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787779545.537857:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87a709a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c28aae66-2825-42c5-8f52-61f687e868c9:3305:1874622524993920:0@lo:400:kworker.0 00010000:00010000:3.0:1787779545.719198:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779546.037819:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787779546.037841:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87fd29680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622524994688:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787779546.037904:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779546.037983:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524994688 00000100:00100000:0.0:1787779546.037990:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524994688 00000100:00100000:0.0:1787779546.038043:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787779546.038051:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87fd2a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622524994688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787779546.038087:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787779546.038124:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87fd2a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622524994688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779546.038131:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:0.0:1787779546.038167:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e87fd29680 x1874622524994688/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779562 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779546.038185:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87fd29680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622524994688:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787779546.279479:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779546.279532:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779546.279555:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505035136 00000100:00100000:1.0:1787779546.279565:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505035136 00000100:00100000:1.0:1787779546.279645:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 69 00000100:00100000:1.0:1787779546.279655:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f61d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:2360:x1874622505035136:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:1.0:1787779546.279749:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f61d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:2360:x1874622505035136:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 95us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779546.279757:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 69 00000100:00080000:2.0:1787779546.279761:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787779546.280003:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505035008 00000100:00100000:3.0:1787779546.280008:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505035008 00000100:00100000:3.0:1787779546.280045:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 210 00000100:00100000:3.0:1787779546.280053:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842efd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+10:2360:x1874622505035008:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:3.0:1787779546.280094:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842efd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+10:2360:x1874622505035008:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 42us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779546.280101:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 210 00010000:00010000:0.0:1787779546.747511:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787779546.767597:0:10111:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 17:25:44 (1787779544) === 00000100:00100000:2.0:1787779547.358376:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779547.358525:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505035264 00000100:00100000:0.0:1787779547.358535:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505035264 00000100:00100000:0.0:1787779547.358592:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 211 00000100:00100000:0.0:1787779547.358602:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ef8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+10:8144:x1874622505035264:12345-192.168.201.9@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787779547.358618:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787779547.358637:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e848f68c00/0x9e63ba8af6889016 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedab84 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779547.358693:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e848f68c00/0x9e63ba8af6889016 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedab84 expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779547.358706:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e848f68c00/0x9e63ba8af6889016 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedab84 expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779547.358754:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e848f68c00, rc 0) 00000100:00100000:0.0:1787779547.358828:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ef8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+11:8144:x1874622505035264:12345-192.168.201.9@tcp:101:mount.lustre.0 Request processed in 227us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779547.358843:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 211 00000100:00100000:1.0:1787779547.376924:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779547.377083:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505035392 00000100:00100000:3.0:1787779547.377093:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505035392 00000100:00100000:3.0:1787779547.377149:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 212 00000100:00100000:3.0:1787779547.377183:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ef9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+11:8144:x1874622505035392:12345-192.168.201.9@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787779547.377549:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ef9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+11:8144:x1874622505035392:12345-192.168.201.9@tcp:501:mount.lustre.0 Request processed in 369us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779547.377558:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 212 00000100:00100000:1.0:1787779547.381940:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779547.391450:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505035520 00000100:00100000:2.0:1787779547.391467:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505035520 00000100:00100000:2.0:1787779547.391537:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 213 00000100:00100000:2.0:1787779547.391549:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ef8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+11:8144:x1874622505035520:12345-192.168.201.9@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787779547.392453:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ef8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+11:8144:x1874622505035520:12345-192.168.201.9@tcp:503:mount.lustre.0 Request processed in 901us (10518us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779547.392465:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 213 00000100:00100000:0.0:1787779547.401088:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779547.402370:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505035648 00000100:00100000:1.0:1787779547.402383:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505035648 00000100:00100000:1.0:1787779547.402449:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 214 00000100:00100000:1.0:1787779547.402459:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842efb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+11:8148:x1874622505035648:12345-192.168.201.9@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787779547.402955:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842efb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+11:8148:x1874622505035648:12345-192.168.201.9@tcp:502:llog_process_th.0 Request processed in 495us (1874us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779547.402964:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 214 00000100:00100000:1.0:1787779547.425603:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779547.425752:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505035776 00000100:00100000:3.0:1787779547.425771:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505035776 00000100:00100000:3.0:1787779547.425835:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 215 00000100:00100000:3.0:1787779547.425847:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842efb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+11:8148:x1874622505035776:12345-192.168.201.9@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787779547.426146:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842efb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+11:8148:x1874622505035776:12345-192.168.201.9@tcp:502:llog_process_th.0 Request processed in 300us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779547.426155:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 215 00000100:00100000:0.0:1787779547.439303:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779547.439415:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505035904 00000100:00100000:1.0:1787779547.439424:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505035904 00000100:00100000:1.0:1787779547.439490:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 216 00000100:00100000:1.0:1787779547.439502:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842efa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+11:8144:x1874622505035904:12345-192.168.201.9@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787779547.439521:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779547.439543:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e87a98b200/0x9e63ba8af688901d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedabae expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779547.439576:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e87a98b200/0x9e63ba8af688901d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedabae expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779547.439589:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e87a98b200/0x9e63ba8af688901d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedabae expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779547.439600:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87a98b200, rc 0) 00000100:00100000:1.0:1787779547.440210:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842efa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+12:8144:x1874622505035904:12345-192.168.201.9@tcp:101:mount.lustre.0 Request processed in 708us (916us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779547.440228:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 216 00000100:00100000:0.0:1787779547.454664:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779547.454785:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505036032 00000100:00100000:2.0:1787779547.454797:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505036032 00000100:00100000:2.0:1787779547.454854:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 217 00000100:00100000:2.0:1787779547.454865:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ef9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+12:8144:x1874622505036032:12345-192.168.201.9@tcp:256:mount.lustre.0 20000000:01000000:2.0:1787779547.454892:0:5830:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787779547.454920:0:5830:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787779547.454924:0:5830:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787779547.454927:0:5830:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787779547.454929:0:5830:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1787779547.460678:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ef9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+12:8144:x1874622505036032:12345-192.168.201.9@tcp:256:mount.lustre.0 Request processed in 5800us (6010us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779547.460960:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 217 00000100:00100000:0.0:1787779547.464144:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779547.464290:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505036160 00000100:00100000:1.0:1787779547.464300:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505036160 00000100:00100000:1.0:1787779547.464359:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 218 00000100:00100000:1.0:1787779547.464368:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842efa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+12:8144:x1874622505036160:12345-192.168.201.9@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787779547.464386:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779547.464417:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e87a98a200/0x9e63ba8af6889024 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedabb5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779547.464447:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e87a98a200/0x9e63ba8af6889024 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedabb5 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779547.464458:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e87a98a200/0x9e63ba8af6889024 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedabb5 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779547.464468:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87a98a200, rc 0) 00000100:00100000:1.0:1787779547.464611:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842efa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+13:8144:x1874622505036160:12345-192.168.201.9@tcp:101:mount.lustre.0 Request processed in 242us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779547.464618:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 218 00000100:00100000:0.0:1787779547.466624:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779547.466697:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505036288 00000100:00100000:1.0:1787779547.466706:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505036288 00000100:00100000:1.0:1787779547.466962:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 219 00000100:00100000:1.0:1787779547.466974:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ef9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+13:8144:x1874622505036288:12345-192.168.201.9@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787779547.467280:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ef9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+13:8144:x1874622505036288:12345-192.168.201.9@tcp:501:mount.lustre.0 Request processed in 308us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779547.467288:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 219 00000100:00100000:0.0:1787779547.469603:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779547.469885:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505036416 00000100:00100000:1.0:1787779547.469895:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505036416 00000100:00100000:1.0:1787779547.469994:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 220 00000100:00100000:1.0:1787779547.470004:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ef8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+13:8144:x1874622505036416:12345-192.168.201.9@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787779547.470264:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ef8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+13:8144:x1874622505036416:12345-192.168.201.9@tcp:503:mount.lustre.0 Request processed in 260us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779547.470272:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 220 00000100:00100000:0.0:1787779547.474678:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779547.476089:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505036544 00000100:00100000:1.0:1787779547.476099:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505036544 00000100:00100000:1.0:1787779547.476161:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 221 00000100:00100000:1.0:1787779547.476171:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842efb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+13:8153:x1874622505036544:12345-192.168.201.9@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787779547.476450:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842efb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+13:8153:x1874622505036544:12345-192.168.201.9@tcp:502:llog_process_th.0 Request processed in 279us (1783us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779547.476458:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 221 00000100:00100000:0.0:1787779547.480609:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779547.483035:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505036672 00000100:00100000:1.0:1787779547.483051:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505036672 00000100:00100000:1.0:1787779547.483133:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 222 00000100:00100000:1.0:1787779547.483146:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842efa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+13:8153:x1874622505036672:12345-192.168.201.9@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787779547.483465:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842efa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+13:8153:x1874622505036672:12345-192.168.201.9@tcp:502:llog_process_th.0 Request processed in 319us (2863us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779547.483473:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 222 00000100:00100000:0.0:1787779547.489618:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779547.489663:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779547.490338:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505037184 00000100:00100000:1.0:1787779547.490350:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505037184 00000100:00100000:1.0:1787779547.490447:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505036800 00000100:00100000:1.0:1787779547.490450:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505036800 00000100:00100000:1.0:1787779547.490486:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 70 00000100:00100000:1.0:1787779547.490498:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87fd29680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:2359:x1874622505037184:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:1.0:1787779547.490600:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87fd29680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:2359:x1874622505037184:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 106us (993us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779547.490608:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 70 00000100:00100000:1.0:1787779547.490625:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 10 00000100:00100000:1.0:1787779547.490630:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87fd29a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2356:x1874622505036800:12345-192.168.201.9@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787779547.493495:0:5837:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 54e1e60c-3037-4ae3-b045-838eb9e0ad0b@192.168.201.9@tcp t0 exp 0000000000000000 cur 313 last 0 00000020:00000080:1.0:1787779547.493565:0:5837:0:(genops.c:1385:class_connect()) connect: client 54e1e60c-3037-4ae3-b045-838eb9e0ad0b, cookie 0x9e63ba8af688902b 00000004:00100000:1.0:1787779547.493601:0:5837:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787779547.493901:0:5837:0:(import.c:65:import_set_state_nolock()) ffff98e851782000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787779547.493979:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87fd29a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54e1e60c-3037-4ae3-b045-838eb9e0ad0b+6:2356:x1874622505036800:12345-192.168.201.9@tcp:38:mount.lustre.0 Request processed in 3346us (4314us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779547.493990:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 10 00000100:00100000:0.0:1787779547.504113:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779547.504254:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505036928 00000100:00100000:3.0:1787779547.504264:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505036928 00000100:00100000:3.0:1787779547.504365:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 11 00000100:00100000:3.0:1787779547.504376:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87fd292c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54e1e60c-3037-4ae3-b045-838eb9e0ad0b+6:0:x1874622505036928:12345-192.168.201.9@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787779547.504421:0:5835:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00080000:2.0:1787779547.504469:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787779547.504524:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87fd292c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54e1e60c-3037-4ae3-b045-838eb9e0ad0b+6:0:x1874622505036928:12345-192.168.201.9@tcp:41:mount.lustre.0 Request processed in 150us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779547.504532:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 11 00000100:00100000:0.0:1787779547.504596:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779547.505058:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505037056 00000100:00100000:1.0:1787779547.505063:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505037056 00000100:00100000:1.0:1787779547.505110:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 12 00000100:00100000:1.0:1787779547.505118:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87fd2a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54e1e60c-3037-4ae3-b045-838eb9e0ad0b+6:8144:x1874622505037056:12345-192.168.201.9@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787779547.505134:0:5836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787779547.506040:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87fd2a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54e1e60c-3037-4ae3-b045-838eb9e0ad0b+6:8144:x1874622505037056:12345-192.168.201.9@tcp:41:mount.lustre.0 Request processed in 918us (1439us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779547.506050:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 12 00000100:00100000:2.0:1787779547.521204:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779547.521326:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505037312 00000100:00100000:3.0:1787779547.521339:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505037312 00000100:00100000:3.0:1787779547.521402:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 13 00000100:00100000:3.0:1787779547.521412:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f61e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54e1e60c-3037-4ae3-b045-838eb9e0ad0b+6:8144:x1874622505037312:12345-192.168.201.9@tcp:40:mount.lustre.0 00000100:00100000:3.0:1787779547.521509:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f61e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54e1e60c-3037-4ae3-b045-838eb9e0ad0b+6:8144:x1874622505037312:12345-192.168.201.9@tcp:40:mount.lustre.0 Request processed in 99us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779547.521519:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 13 00000100:00100000:0.0:1787779547.525063:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779547.525106:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779547.525145:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779547.525299:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505037440 00000100:00100000:2.0:1787779547.525309:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505037440 00000100:00100000:2.0:1787779547.525356:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505037568 00000100:00100000:2.0:1787779547.525359:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505037568 00000100:00100000:2.0:1787779547.525374:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 12 00000100:00100000:2.0:1787779547.525400:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87fd28b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2356:x1874622505037440:12345-192.168.201.9@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787779547.525434:0:6680:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 54e1e60c-3037-4ae3-b045-838eb9e0ad0b@192.168.201.9@tcp t0 exp 0000000000000000 cur 313 last 0 00000020:00000080:2.0:1787779547.525473:0:6680:0:(genops.c:1385:class_connect()) connect: client 54e1e60c-3037-4ae3-b045-838eb9e0ad0b, cookie 0x9e63ba8af6889032 00002000:00100000:2.0:1787779547.525485:0:6680:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 54e1e60c-3037-4ae3-b045-838eb9e0ad0b/ffff98e87a56e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113939 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787779547.525509:0:6680:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787779547.525808:0:6680:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787779547.526028:0:6680:0:(import.c:65:import_set_state_nolock()) ffff98e87a56a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787779547.526105:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87fd28b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:54e1e60c-3037-4ae3-b045-838eb9e0ad0b+6:2356:x1874622505037440:12345-192.168.201.9@tcp:8:mount.lustre.0 Request processed in 705us (1052us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779547.526114:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 12 00000100:00100000:2.0:1787779547.526137:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 13 00000100:00100000:2.0:1787779547.526143:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87fd2ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2356:x1874622505037568:12345-192.168.201.9@tcp:8:mount.lustre.0 00000100:00100000:3.0:1787779547.526363:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505037696 00000100:00100000:3.0:1787779547.526369:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505037696 00000100:00100000:3.0:1787779547.526406:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 1 00000100:00100000:3.0:1787779547.526414:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87fd29e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54e1e60c-3037-4ae3-b045-838eb9e0ad0b+6:8144:x1874622505037696:12345-192.168.201.9@tcp:33:mount.lustre.0 00000004:00200000:3.0:1787779547.526596:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00010000:00080000:2.0:1787779547.526827:0:6680:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 54e1e60c-3037-4ae3-b045-838eb9e0ad0b@192.168.201.9@tcp t0 exp 0000000000000000 cur 313 last 0 00000020:00000080:2.0:1787779547.526980:0:6680:0:(genops.c:1385:class_connect()) connect: client 54e1e60c-3037-4ae3-b045-838eb9e0ad0b, cookie 0x9e63ba8af6889039 00002000:00100000:2.0:1787779547.526989:0:6680:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 54e1e60c-3037-4ae3-b045-838eb9e0ad0b/ffff98e87a569800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113939 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787779547.527008:0:6680:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787779547.527150:0:6680:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787779547.527390:0:6680:0:(import.c:65:import_set_state_nolock()) ffff98e87a56e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787779547.527436:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87fd2ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:54e1e60c-3037-4ae3-b045-838eb9e0ad0b+6:2356:x1874622505037568:12345-192.168.201.9@tcp:8:mount.lustre.0 Request processed in 1291us (2329us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779547.527445:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 13 00000100:00100000:3.0:1787779547.532697:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87fd29e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54e1e60c-3037-4ae3-b045-838eb9e0ad0b+6:8144:x1874622505037696:12345-192.168.201.9@tcp:33:mount.lustre.0 Request processed in 6264us (7531us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779547.532728:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 1 00010000:00010000:3.0:1787779547.762912:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787779548.787088:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779549.620351:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87aa303c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874622524994816:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787779549.620417:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779549.620484:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524994816 00000100:00100000:3.0:1787779549.620489:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524994816 00000100:00100000:3.0:1787779549.620557:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787779549.620564:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87aa321c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874622524994816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787779549.620595:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787779549.620628:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87aa321c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874622524994816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779549.620633:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:3.0:1787779549.620648:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787779549.620670:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e87aa303c0 x1874622524994816/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779565 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779549.620687:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87aa303c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874622524994816:0@lo:13:osp-pre-0-0.0 00000001:00100000:0.0:1787779549.697255:0:6704:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 54e1e60c-3037-4ae3-b045-838eb9e0ad0b 00010000:00010000:0.0:1787779549.811300:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787779550.232841:0:7634:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 54e1e60c-3037-4ae3-b045-838eb9e0ad0b 00000001:00100000:1.0:1787779550.243087:0:5857:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 54e1e60c-3037-4ae3-b045-838eb9e0ad0b 00000100:00100000:1.0:1787779550.643090:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f539a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874622524995072:0@lo:400:kworker.0 00000100:00100000:0.0:1787779550.643246:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787779550.643267:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f53b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c28aae66-2825-42c5-8f52-61f687e868c9:3304:1874622524994944:0@lo:400:kworker.0 00000100:00100000:0.0:1787779550.643324:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779550.643422:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779550.643470:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524994944 00000100:00100000:1.0:1787779550.643477:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524994944 00000100:00100000:1.0:1787779550.643525:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1787779550.643533:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842efac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+19:3304:x1874622524994944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779550.643583:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842efac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+19:3304:x1874622524994944:12345-0@lo:400:kworker.0 Request processed in 50us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779550.643589:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1787779550.643875:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524995072 00000100:00100000:0.0:1787779550.643880:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524995072 00000100:00100000:1.0:1787779550.644083:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f53b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c28aae66-2825-42c5-8f52-61f687e868c9:3304:1874622524994944:0@lo:400:kworker.0 00000100:00100000:1.0:1787779550.644144:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f53b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874622524995200:0@lo:400:kworker.0 00000100:00100000:1.0:1787779550.644195:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779550.648101:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524995200 00000100:00100000:0.0:1787779550.648125:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524995200 00000100:00100000:2.0:1787779550.648406:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787779550.648420:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f53a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874622524995072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779550.648506:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f53a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874622524995072:12345-0@lo:400:kworker.0 Request processed in 90us (5082us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779550.648513:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787779550.648581:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787779550.648588:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f5383c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874622524995200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779550.648624:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f5383c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874622524995200:12345-0@lo:400:kworker.0 Request processed in 37us (4428us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779550.648794:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:2.0:1787779550.648814:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787779550.648848:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f53b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874622524995200:0@lo:400:kworker.0 00000100:00100000:2.0:1787779550.649266:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87fd2bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874622524995328:0@lo:400:kworker.0 00000100:00100000:2.0:1787779550.649313:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779550.649349:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787779550.649355:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ec18780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874622524995456:0@lo:400:kworker.0 00000100:00100000:2.0:1787779550.649380:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779550.649405:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524995456 00000100:00100000:2.0:1787779550.649410:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524995456 00000100:00100000:2.0:1787779550.649443:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787779550.649451:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f61c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874622524995456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779550.649485:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f61c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874622524995456:12345-0@lo:400:kworker.0 Request processed in 36us (104us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779550.649492:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:2.0:1787779550.649507:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787779550.649525:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ec18780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874622524995456:0@lo:400:kworker.0 00000100:00100000:2.0:1787779550.649542:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787779550.649559:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ec1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622524995584:0@lo:400:kworker.0 00000100:00100000:2.0:1787779550.649587:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779550.649610:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524995328 00000100:00100000:2.0:1787779550.649614:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524995328 00000100:00100000:2.0:1787779550.649764:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524995584 00000100:00100000:2.0:1787779550.649768:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524995584 00000100:00100000:0.0:1787779550.650126:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787779550.650136:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f61c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874622524995328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779550.650374:0:6682:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1787779550.650383:0:6682:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1787779550.650400:0:6680:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1787779550.650411:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787779550.650419:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a709a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622524995584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779550.650478:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a709a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622524995584:12345-0@lo:400:kworker.0 Request processed in 59us (890us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779550.650485:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:2.0:1787779550.650504:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787779550.650744:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f61c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874622524995328:12345-0@lo:400:kworker.0 Request processed in 609us (1429us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779550.650751:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:2.0:1787779550.651003:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e87ec1b480 x1874622524995584/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779566 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779550.651016:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ec1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622524995584:0@lo:400:kworker.0 00000100:00100000:0.0:1787779550.651311:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f539a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874622524995072:0@lo:400:kworker.0 00010000:00080000:3.0:1787779550.651416:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e87fd2bc00 x1874622524995328/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779566 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779550.651427:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87fd2bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874622524995328:0@lo:400:kworker.0 00010000:00010000:3.0:1787779550.834822:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779551.158953:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787779551.158979:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ec1a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622524995712:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787779551.159054:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779551.159143:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524995712 00000100:00100000:0.0:1787779551.159159:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524995712 00000100:00100000:0.0:1787779551.159209:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787779551.159217:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec1ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622524995712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787779551.159249:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787779551.159291:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec1ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622524995712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779551.159298:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:0.0:1787779551.159340:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e87ec1a1c0 x1874622524995712/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779567 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779551.159359:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ec1a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622524995712:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787779551.858951:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779552.882976:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779552.936248:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779552.936310:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779552.936347:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779552.936376:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779552.936420:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779552.936462:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505038336 00000100:00100000:0.0:1787779552.936472:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505038336 00000100:00100000:0.0:1787779552.936531:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505038208 00000100:00100000:0.0:1787779552.936534:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505038208 00000100:00100000:0.0:1787779552.936560:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 42 00000100:00100000:0.0:1787779552.936571:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e881a69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:54e1e60c-3037-4ae3-b045-838eb9e0ad0b+5:2357:x1874622505038336:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:1.0:1787779552.936626:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505038080 00000100:00100000:1.0:1787779552.936632:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505038080 00000100:00100000:1.0:1787779552.936668:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505037952 00000100:00100000:1.0:1787779552.936671:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505037952 00000100:00100000:1.0:1787779552.936695:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 74 00000100:00100000:1.0:1787779552.936703:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec1a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54e1e60c-3037-4ae3-b045-838eb9e0ad0b+5:2357:x1874622505038080:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:3.0:1787779552.936746:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505037824 00000100:00100000:3.0:1787779552.936751:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505037824 00000100:00100000:3.0:1787779552.936788:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 224 00000100:00100000:3.0:1787779552.936797:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ef8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+13:2357:x1874622505037824:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:1.0:1787779552.936802:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec1a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54e1e60c-3037-4ae3-b045-838eb9e0ad0b+5:2357:x1874622505038080:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 97us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779552.936812:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 74 00000100:00100000:3.0:1787779552.936832:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ef8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+13:2357:x1874622505037824:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 36us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779552.936841:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 224 00000100:00100000:1.0:1787779552.936845:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 75 00000100:00100000:1.0:1787779552.936856:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec1bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:2357:x1874622505037952:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:3.0:1787779552.936879:0:10229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 43 00000100:00100000:1.0:1787779552.936890:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec1bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:2357:x1874622505037952:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 34us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779552.936891:0:10229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec19a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:54e1e60c-3037-4ae3-b045-838eb9e0ad0b+5:2357:x1874622505038208:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:1.0:1787779552.936902:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 75 00000100:00100000:3.0:1787779552.936937:0:10229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec19a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:54e1e60c-3037-4ae3-b045-838eb9e0ad0b+5:2357:x1874622505038208:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 49us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779552.936945:0:10229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 43 00000100:00080000:3.0:1787779552.937003:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787779552.937008:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787779552.937010:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787779552.937089:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e881a69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:54e1e60c-3037-4ae3-b045-838eb9e0ad0b+5:2357:x1874622505038336:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 520us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779552.937095:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 42 00000001:02000400:0.0:1787779553.890610:0:10310:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg109-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:3.0:1787779553.907802:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779554.747899:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87a70b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874622524995840:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787779554.747975:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779554.748074:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524995840 00000100:00100000:2.0:1787779554.748082:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524995840 00000100:00100000:2.0:1787779554.748155:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787779554.748165:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec192c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874622524995840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787779554.748198:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787779554.748248:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec192c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874622524995840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779554.748255:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1787779554.748260:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e87a70b840 x1874622524995840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779570 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779554.748293:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87a70b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874622524995840:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787779554.748296:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787779554.935839:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779555.763179:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f538b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c28aae66-2825-42c5-8f52-61f687e868c9:3305:1874622524995968:0@lo:400:kworker.0 00000100:00100000:3.0:1787779555.763280:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779555.763584:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f539680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874622524996352:0@lo:400:kworker.0 00000100:00100000:2.0:1787779555.763626:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779555.763670:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f538f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874622524996224:0@lo:400:kworker.0 00000100:00100000:2.0:1787779555.763706:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779555.763768:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787779555.763775:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f53a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874622524996096:0@lo:400:kworker.0 00000100:00100000:2.0:1787779555.763799:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779555.766140:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524995968 00000100:00100000:0.0:1787779555.766158:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524995968 00000100:00100000:0.0:1787779555.766351:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1787779555.766364:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ef9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+19:3305:x1874622524995968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779555.766646:0:10229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524996352 00000100:00100000:3.0:1787779555.766651:0:10229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524996352 00000100:00100000:3.0:1787779555.766693:0:10229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787779555.766701:0:10229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a70a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874622524996352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779555.766781:0:10229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a70a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874622524996352:12345-0@lo:400:kworker.0 Request processed in 80us (3153us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779555.766789:0:10229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:3.0:1787779555.766833:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e87f539680 x1874622524996352/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779571 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779555.766848:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f539680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874622524996352:0@lo:400:kworker.0 00000100:00100000:1.0:1787779555.770531:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f53a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622524996608:0@lo:400:kworker.0 00000100:00100000:1.0:1787779555.770606:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779555.770678:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524996224 00000100:00100000:1.0:1787779555.770688:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524996224 00000100:00100000:1.0:1787779555.770771:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524996096 00000100:00100000:1.0:1787779555.770775:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524996096 00000100:00100000:1.0:1787779555.770801:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787779555.770811:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a708f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874622524996224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779555.770864:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a708f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874622524996224:12345-0@lo:400:kworker.0 Request processed in 55us (7157us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779555.770888:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787779555.770905:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787779555.770912:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a70b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874622524996096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779555.770943:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a70b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874622524996096:12345-0@lo:400:kworker.0 Request processed in 32us (7143us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779555.770949:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:1.0:1787779555.770969:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787779555.770982:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787779555.770991:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f5392c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874622524996480:0@lo:400:kworker.0 00000100:00100000:1.0:1787779555.771020:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779555.771081:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f53a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874622524996096:0@lo:400:kworker.0 00000100:00100000:1.0:1787779555.771097:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f538f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874622524996224:0@lo:400:kworker.0 00000100:00100000:1.0:1787779555.771123:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524996480 00000100:00100000:1.0:1787779555.771126:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524996480 00000100:00100000:1.0:1787779555.771153:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787779555.771159:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f53b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874622524996480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779555.771194:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f53b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874622524996480:12345-0@lo:400:kworker.0 Request processed in 36us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779555.771200:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:1.0:1787779555.771214:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787779555.771230:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f5392c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874622524996480:0@lo:400:kworker.0 00000100:00100000:2.0:1787779555.772528:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524996608 00000100:00100000:2.0:1787779555.772539:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524996608 00000100:00100000:2.0:1787779555.772614:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787779555.772623:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f53b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622524996608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779555.772691:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f53b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622524996608:12345-0@lo:400:kworker.0 Request processed in 69us (2085us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779555.772698:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1787779555.772923:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e87f53a940 x1874622524996608/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779571 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779555.772945:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f53a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622524996608:0@lo:400:kworker.0 00000100:00080000:1.0:1787779555.772984:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787779555.776531:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ef9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+19:3305:x1874622524995968:12345-0@lo:400:kworker.0 Request processed in 10161us (13246us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779555.776793:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f538b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c28aae66-2825-42c5-8f52-61f687e868c9:3305:1874622524995968:0@lo:400:kworker.0 00000100:00100000:0.0:1787779555.776917:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00010000:00010000:0.0:1787779555.961090:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779556.287475:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f53a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622524996736:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787779556.287545:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779556.288864:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524996736 00000100:00100000:1.0:1787779556.288876:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524996736 00000100:00100000:1.0:1787779556.288942:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787779556.288952:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f5392c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622524996736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787779556.288989:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787779556.289071:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f5392c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622524996736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (1515us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779556.289079:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:1.0:1787779556.289126:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e87f53a940 x1874622524996736/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779572 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779556.289147:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f53a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622524996736:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787779556.978920:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779558.003241:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779558.051232:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779558.051279:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779558.051308:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779558.051330:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779558.051357:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779558.051404:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505038720 00000100:00100000:3.0:1787779558.051413:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505038720 00000100:00100000:3.0:1787779558.051467:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505038592 00000100:00100000:3.0:1787779558.051470:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505038592 00000100:00100000:3.0:1787779558.051492:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 79 00000100:00100000:3.0:1787779558.051502:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87aa32d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54e1e60c-3037-4ae3-b045-838eb9e0ad0b+5:2359:x1874622505038720:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:3.0:1787779558.051585:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87aa32d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54e1e60c-3037-4ae3-b045-838eb9e0ad0b+5:2359:x1874622505038720:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 84us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779558.051593:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 79 00000100:00100000:3.0:1787779558.051609:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 80 00000100:00100000:3.0:1787779558.051616:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87aa32580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:2359:x1874622505038592:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:3.0:1787779558.051638:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87aa32580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:2359:x1874622505038592:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 23us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779558.051644:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 80 00000100:00100000:3.0:1787779558.051660:0:10229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505038976 00000100:00100000:3.0:1787779558.051663:0:10229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505038976 00000100:00100000:3.0:1787779558.051686:0:10229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505038848 00000100:00100000:3.0:1787779558.051689:0:10229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505038848 00000100:00100000:3.0:1787779558.051706:0:10229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 46 00000100:00100000:3.0:1787779558.051739:0:10229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87aa30b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:54e1e60c-3037-4ae3-b045-838eb9e0ad0b+5:2359:x1874622505038976:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:3.0:1787779558.051763:0:10229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87aa30b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:54e1e60c-3037-4ae3-b045-838eb9e0ad0b+5:2359:x1874622505038976:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 52us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779558.051770:0:10229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 46 00000100:00100000:3.0:1787779558.051780:0:10229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 47 00000100:00100000:3.0:1787779558.051798:0:10229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87aa30780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:54e1e60c-3037-4ae3-b045-838eb9e0ad0b+5:2359:x1874622505038848:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:3.0:1787779558.051819:0:10229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87aa30780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:54e1e60c-3037-4ae3-b045-838eb9e0ad0b+5:2359:x1874622505038848:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 35us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779558.051832:0:10229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 47 00000100:00080000:3.0:1787779558.051854:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787779558.051857:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787779558.051860:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787779558.051926:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505038464 00000100:00100000:1.0:1787779558.051930:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505038464 00000100:00100000:1.0:1787779558.051962:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 226 00000100:00100000:1.0:1787779558.051969:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842efbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+13:2359:x1874622505038464:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:1.0:1787779558.052003:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842efbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+13:2359:x1874622505038464:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 35us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779558.052009:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 226 00010000:00010000:1.0:1787779559.027140:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779559.859075:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ec1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874622524996864:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787779559.859150:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779559.859862:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524996864 00000100:00100000:3.0:1787779559.859871:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524996864 00000100:00100000:3.0:1787779559.859962:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787779559.859972:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f53a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874622524996864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787779559.860024:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1787779559.860152:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787779559.860231:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f53a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874622524996864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 260us (1079us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779559.860238:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:1.0:1787779559.860302:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e87ec1b480 x1874622524996864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779575 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779559.860339:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ec1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874622524996864:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787779560.050989:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779560.883845:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f538b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874622524997376:0@lo:400:kworker.0 00000100:00100000:1.0:1787779560.883919:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779560.883953:0:10229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524997376 00000100:00100000:3.0:1787779560.883961:0:10229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524997376 00000100:00100000:1.0:1787779560.883996:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787779560.884002:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f538f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c28aae66-2825-42c5-8f52-61f687e868c9:3304:1874622524996992:0@lo:400:kworker.0 00000100:00100000:3.0:1787779560.884021:0:10229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787779560.884030:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779560.884031:0:10229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f539a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874622524997376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779560.884057:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f539680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874622524997504:0@lo:400:kworker.0 00000100:00100000:1.0:1787779560.886577:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779560.886668:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f53a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874622524997120:0@lo:400:kworker.0 00000100:00100000:2.0:1787779560.886669:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524997504 00000100:00100000:2.0:1787779560.886678:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524997504 00000100:00100000:1.0:1787779560.886736:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779560.886759:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f53bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622524997632:0@lo:400:kworker.0 00000100:00100000:2.0:1787779560.886765:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524997120 00000100:00100000:2.0:1787779560.886768:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524997120 00000100:00100000:1.0:1787779560.886785:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779560.886792:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787779560.886801:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f53b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874622524997504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779560.886805:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787779560.886812:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f538780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874622524997248:0@lo:400:kworker.0 00000100:00100000:2.0:1787779560.886855:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f53b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874622524997504:12345-0@lo:400:kworker.0 Request processed in 56us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779560.886856:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779560.886862:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787779560.886879:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524997248 00000100:00100000:2.0:1787779560.886882:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524997248 00000100:00100000:2.0:1787779560.886899:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787779560.886904:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f539e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874622524997120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779560.886959:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f539e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874622524997120:12345-0@lo:400:kworker.0 Request processed in 55us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779560.886965:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787779560.886989:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787779560.886997:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e88195ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874622524997248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779560.887025:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e88195ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874622524997248:12345-0@lo:400:kworker.0 Request processed in 29us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779560.887026:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524996992 00000100:00100000:2.0:1787779560.887030:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787779560.887031:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524996992 00000100:00080000:2.0:1787779560.887046:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787779560.887056:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1787779560.887061:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ebfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+19:3304:x1874622524996992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779560.887082:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f539680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874622524997504:0@lo:400:kworker.0 00000100:00100000:1.0:1787779560.887092:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ebfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+19:3304:x1874622524996992:12345-0@lo:400:kworker.0 Request processed in 32us (3062us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779560.887097:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1787779560.887103:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f538f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c28aae66-2825-42c5-8f52-61f687e868c9:3304:1874622524996992:0@lo:400:kworker.0 00000100:00100000:2.0:1787779560.887123:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f538780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874622524997248:0@lo:400:kworker.0 00000100:00100000:2.0:1787779560.887132:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f53a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874622524997120:0@lo:400:kworker.0 00000100:00100000:3.0:1787779560.889803:0:10229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f539a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874622524997376:12345-0@lo:400:kworker.0 Request processed in 5763us (5872us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779560.889818:0:10229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787779560.889846:0:10229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524997632 00000100:00100000:3.0:1787779560.889853:0:10229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524997632 00000100:00100000:3.0:1787779560.889896:0:10229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787779560.889904:0:10229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f53ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622524997632:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787779560.891077:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787779560.891639:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e87f53bc00 x1874622524997632/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779576 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779560.891676:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f53bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622524997632:0@lo:400:kworker.0 00010000:00080000:2.0:1787779560.899179:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e87f538b40 x1874622524997376/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779576 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779560.899199:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f538b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874622524997376:0@lo:400:kworker.0 00000100:00100000:3.0:1787779560.901863:0:10229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f53ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622524997632:12345-0@lo:400:kworker.0 Request processed in 11948us (15065us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779560.901881:0:10229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00010000:0.0:1787779561.077273:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787779561.395890:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e88195de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622524997760:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787779561.395968:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779561.396843:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524997760 00000100:00100000:2.0:1787779561.396856:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524997760 00000100:00100000:2.0:1787779561.396911:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787779561.396921:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a7092c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622524997760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787779561.396963:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787779561.397091:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a7092c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622524997760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 171us (1124us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779561.397100:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:0.0:1787779561.397770:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e88195de00 x1874622524997760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779577 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779561.397794:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e88195de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622524997760:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787779562.099111:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779563.123760:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787779563.173323:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779563.173362:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779563.173391:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779563.173410:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779563.173434:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779563.173460:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505039488 00000100:00100000:2.0:1787779563.173470:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505039488 00000100:00100000:2.0:1787779563.173523:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505039616 00000100:00100000:2.0:1787779563.173526:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505039616 00000100:00100000:2.0:1787779563.173546:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 50 00000100:00100000:2.0:1787779563.173555:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a708b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:54e1e60c-3037-4ae3-b045-838eb9e0ad0b+5:2357:x1874622505039488:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:2.0:1787779563.173631:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a708b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:54e1e60c-3037-4ae3-b045-838eb9e0ad0b+5:2357:x1874622505039488:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 77us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779563.173639:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 50 00000100:00100000:2.0:1787779563.173668:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 51 00000100:00100000:2.0:1787779563.173674:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a7083c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:54e1e60c-3037-4ae3-b045-838eb9e0ad0b+5:2357:x1874622505039616:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:2.0:1787779563.173699:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a7083c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:54e1e60c-3037-4ae3-b045-838eb9e0ad0b+5:2357:x1874622505039616:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 25us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779563.173705:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 51 00000100:00100000:2.0:1787779563.173743:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505039104 00000100:00100000:2.0:1787779563.173746:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505039104 00000100:00100000:2.0:1787779563.173773:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 228 00000100:00100000:2.0:1787779563.173794:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ebcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+13:2357:x1874622505039104:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:2.0:1787779563.173820:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ebcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+13:2357:x1874622505039104:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 28us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779563.173825:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 228 00000100:00100000:2.0:1787779563.173853:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505039232 00000100:00100000:2.0:1787779563.173857:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505039232 00000100:00100000:2.0:1787779563.173883:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505039360 00000100:00100000:2.0:1787779563.173886:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505039360 00000100:00100000:2.0:1787779563.173906:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 84 00000100:00100000:2.0:1787779563.173912:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a70bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:2357:x1874622505039232:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:2.0:1787779563.173950:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a70bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:2357:x1874622505039232:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 27us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779563.173957:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 84 00000100:00100000:2.0:1787779563.173969:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 85 00000100:00100000:2.0:1787779563.173976:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a709a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54e1e60c-3037-4ae3-b045-838eb9e0ad0b+5:2357:x1874622505039360:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:2.0:1787779563.173998:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a709a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54e1e60c-3037-4ae3-b045-838eb9e0ad0b+5:2357:x1874622505039360:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 24us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779563.174017:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 85 00000100:00080000:2.0:1787779563.174036:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787779563.174041:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787779563.174042:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787779564.148287:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779564.982232:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ec18780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874622524997888:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787779564.982309:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779564.983677:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524997888 00000100:00100000:0.0:1787779564.983689:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524997888 00000100:00100000:0.0:1787779564.983779:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787779564.983790:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e88195cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874622524997888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787779564.983830:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1787779564.983884:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787779564.983920:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e88195cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874622524997888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 132us (1611us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779564.983928:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1787779564.983934:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e87ec18780 x1874622524997888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779580 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779564.983953:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ec18780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874622524997888:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787779565.171113:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779566.002993:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e88195da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874622524998144:0@lo:400:kworker.0 00000100:00100000:1.0:1787779566.003068:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779566.003120:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e88195d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622524998656:0@lo:400:kworker.0 00000100:00100000:1.0:1787779566.003144:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779566.003175:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787779566.003181:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e88195e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874622524998272:0@lo:400:kworker.0 00000100:00100000:1.0:1787779566.003202:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779566.003207:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e88195c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874622524998400:0@lo:400:kworker.0 00000100:00100000:3.0:1787779566.003247:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779566.003250:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524998144 00000100:00100000:1.0:1787779566.003256:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524998144 00000100:00100000:3.0:1787779566.003266:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787779566.003271:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e88195f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c28aae66-2825-42c5-8f52-61f687e868c9:3304:1874622524998016:0@lo:400:kworker.0 00000100:00100000:3.0:1787779566.003297:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779566.003297:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524998272 00000100:00100000:1.0:1787779566.003299:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524998272 00000100:00100000:3.0:1787779566.003316:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e88195cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874622524998528:0@lo:400:kworker.0 00000100:00100000:1.0:1787779566.003329:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787779566.003336:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779566.003337:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e88195d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874622524998144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779566.003397:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e88195d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874622524998144:12345-0@lo:400:kworker.0 Request processed in 60us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779566.003406:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787779566.003425:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524998528 00000100:00100000:1.0:1787779566.003437:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524998528 00000100:00100000:1.0:1787779566.003456:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787779566.003461:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e88195f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874622524998272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779566.003476:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e88195da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874622524998144:0@lo:400:kworker.0 00000100:00100000:1.0:1787779566.003507:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e88195f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874622524998272:12345-0@lo:400:kworker.0 Request processed in 45us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779566.003513:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787779566.003514:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e88195e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874622524998272:0@lo:400:kworker.0 00000100:00100000:1.0:1787779566.003525:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787779566.003531:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87aa33840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874622524998528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779566.003567:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87aa33840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874622524998528:12345-0@lo:400:kworker.0 Request processed in 37us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779566.003573:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787779566.003591:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524998656 00000100:00100000:1.0:1787779566.003595:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524998656 00000100:00100000:1.0:1787779566.003616:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524998400 00000100:00100000:1.0:1787779566.003619:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524998400 00000100:00100000:1.0:1787779566.003635:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787779566.003641:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e88195e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622524998656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779566.003671:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e88195e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622524998656:12345-0@lo:400:kworker.0 Request processed in 30us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779566.003676:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787779566.003686:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787779566.003693:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87aa330c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874622524998400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779566.003743:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87aa330c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874622524998400:12345-0@lo:400:kworker.0 Request processed in 51us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779566.003748:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787779566.003772:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524998016 00000100:00100000:1.0:1787779566.003776:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524998016 00000100:00100000:1.0:1787779566.003805:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1787779566.003811:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ebdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+19:3304:x1874622524998016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779566.003840:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ebdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+19:3304:x1874622524998016:12345-0@lo:400:kworker.0 Request processed in 29us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779566.003846:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00080000:1.0:1787779566.003869:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787779566.003873:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787779566.003875:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787779566.005876:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e88195f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c28aae66-2825-42c5-8f52-61f687e868c9:3304:1874622524998016:0@lo:400:kworker.0 00000100:00100000:3.0:1787779566.005909:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e88195cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874622524998528:0@lo:400:kworker.0 00010000:00080000:3.0:1787779566.005926:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e88195c3c0 x1874622524998400/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779582 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779566.005937:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e88195c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874622524998400:0@lo:400:kworker.0 00010000:00080000:3.0:1787779566.005991:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e88195d680 x1874622524998656/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779582 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779566.006001:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e88195d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622524998656:0@lo:400:kworker.0 00010000:00010000:0.0:1787779566.194974:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787779566.517229:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ec18780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622524998784:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787779566.517319:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779566.517510:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524998784 00000100:00100000:0.0:1787779566.517519:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524998784 00000100:00100000:0.0:1787779566.517574:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787779566.517583:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a70b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622524998784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787779566.517622:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787779566.517675:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a70b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622524998784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779566.517690:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:2.0:1787779566.518385:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e87ec18780 x1874622524998784/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779582 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779566.518406:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ec18780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622524998784:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787779567.219016:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779568.251746:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787779568.289772:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779568.289814:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779568.289843:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505039872 00000100:00100000:2.0:1787779568.289863:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505039872 00000100:00100000:2.0:1787779568.289928:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 89 00000100:00100000:2.0:1787779568.289938:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f538b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:2357:x1874622505039872:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:2.0:1787779568.290017:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f538b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:2357:x1874622505039872:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 79us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779568.290024:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 89 00000100:00080000:2.0:1787779568.290047:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787779568.290253:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505039744 00000100:00100000:3.0:1787779568.290257:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505039744 00000100:00100000:3.0:1787779568.290292:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 230 00000100:00100000:3.0:1787779568.290299:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ebc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+13:2357:x1874622505039744:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:3.0:1787779568.290369:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ebc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+13:2357:x1874622505039744:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 71us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779568.290384:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 230 00000100:00100000:2.0:1787779568.292772:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779568.292808:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779568.292833:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779568.292871:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505040128 00000100:00100000:2.0:1787779568.292880:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505040128 00000100:00100000:2.0:1787779568.292933:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505040256 00000100:00100000:2.0:1787779568.292936:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505040256 00000100:00100000:2.0:1787779568.292956:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 14 00000100:00100000:2.0:1787779568.292967:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f53bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:54e1e60c-3037-4ae3-b045-838eb9e0ad0b+5:2356:x1874622505040128:12345-192.168.201.9@tcp:9:kworker.0 00000020:00000080:2.0:1787779568.292997:0:6680:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9e63ba8af6889032 00000100:00080000:2.0:1787779568.293006:0:6680:0:(import.c:65:import_set_state_nolock()) ffff98e87a56a000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787779568.293044:0:6680:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1787779568.293383:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f53bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:54e1e60c-3037-4ae3-b045-838eb9e0ad0b+2:2356:x1874622505040128:12345-192.168.201.9@tcp:9:kworker.0 Request processed in 417us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779568.293392:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 14 00000100:00100000:2.0:1787779568.293422:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 15 00000100:00100000:2.0:1787779568.293442:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f53a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:54e1e60c-3037-4ae3-b045-838eb9e0ad0b+5:2356:x1874622505040256:12345-192.168.201.9@tcp:9:kworker.0 00000020:00000080:2.0:1787779568.293455:0:6680:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9e63ba8af6889039 00000100:00080000:2.0:1787779568.293461:0:6680:0:(import.c:65:import_set_state_nolock()) ffff98e87a56e800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787779568.293482:0:6680:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1787779568.293661:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f53a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:54e1e60c-3037-4ae3-b045-838eb9e0ad0b+2:2356:x1874622505040256:12345-192.168.201.9@tcp:9:kworker.0 Request processed in 220us (852us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779568.293669:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 15 00000100:00100000:2.0:1787779568.293694:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505040000 00000100:00100000:2.0:1787779568.293698:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505040000 00000100:00100000:2.0:1787779568.293751:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 90 00000100:00100000:2.0:1787779568.293758:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f538780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54e1e60c-3037-4ae3-b045-838eb9e0ad0b+5:2358:x1874622505040000:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:2.0:1787779568.293789:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f538780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54e1e60c-3037-4ae3-b045-838eb9e0ad0b+5:2358:x1874622505040000:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 32us (955us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779568.293796:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 90 00000100:00080000:2.0:1787779568.293813:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787779568.293817:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787779568.293819:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787779568.293836:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779568.293970:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779569.272495:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787779570.099056:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787779570.099088:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e88195c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874622524998912:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787779570.099162:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779570.099277:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524998912 00000100:00100000:1.0:1787779570.099285:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524998912 00000100:00100000:1.0:1787779570.099344:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787779570.099353:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f539680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874622524998912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787779570.099387:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787779570.099432:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f539680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874622524998912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779570.099439:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1787779570.099494:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e88195c780 x1874622524998912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779586 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779570.099511:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e88195c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874622524998912:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787779570.099928:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:0.0:1787779570.194742:0:6704:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 54e1e60c-3037-4ae3-b045-838eb9e0ad0b 00000020:00000080:0.0:1787779570.194752:0:6704:0:(genops.c:885:class_export_put()) final put ffff98e87a56e000/54e1e60c-3037-4ae3-b045-838eb9e0ad0b 00000020:00000080:1.0:1787779570.194895:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98e87a56e000/54e1e60c-3037-4ae3-b045-838eb9e0ad0b for lustre-OST0000 00000020:00000080:1.0:1787779570.194954:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98e87a56a000 for lustre-OST0000 00010000:00010000:2.0:1787779570.295326:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787779570.685237:0:7634:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 54e1e60c-3037-4ae3-b045-838eb9e0ad0b 00000020:00000080:1.0:1787779570.685246:0:7634:0:(genops.c:885:class_export_put()) final put ffff98e87a569800/54e1e60c-3037-4ae3-b045-838eb9e0ad0b 00000020:00000080:2.0:1787779570.685956:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff98e87a569800/54e1e60c-3037-4ae3-b045-838eb9e0ad0b for lustre-OST0001 00000020:00000080:3.0:1787779570.688606:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98e87a56e800 for lustre-OST0001 00000100:00100000:2.0:1787779571.136303:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e848f34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874622524999424:0@lo:400:kworker.0 00000100:00100000:2.0:1787779571.136374:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779571.136446:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787779571.136453:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f538f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c28aae66-2825-42c5-8f52-61f687e868c9:3304:1874622524999040:0@lo:400:kworker.0 00000100:00100000:2.0:1787779571.136480:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779571.136503:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e848f36d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874622524999552:0@lo:400:kworker.0 00000100:00100000:2.0:1787779571.136527:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779571.136551:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e848f370c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874622524999168:0@lo:400:kworker.0 00000100:00100000:2.0:1787779571.136573:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779571.136589:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e848f36580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622524999680:0@lo:400:kworker.0 00000100:00100000:2.0:1787779571.136607:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779571.136624:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787779571.136629:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e848f34780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874622524999296:0@lo:400:kworker.0 00000100:00100000:2.0:1787779571.136651:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779571.136679:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524999424 00000100:00100000:2.0:1787779571.136686:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524999424 00000100:00100000:2.0:1787779571.136749:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524999680 00000100:00100000:2.0:1787779571.136752:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524999680 00000100:00100000:2.0:1787779571.136780:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787779571.136809:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e848f35e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874622524999424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779571.136859:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e848f35e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874622524999424:12345-0@lo:400:kworker.0 Request processed in 59us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779571.136867:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787779571.136883:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787779571.136889:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e848f37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622524999680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779571.136919:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e848f37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622524999680:12345-0@lo:400:kworker.0 Request processed in 31us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779571.136925:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787779571.136950:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524999040 00000100:00100000:2.0:1787779571.136953:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524999040 00000100:00100000:2.0:1787779571.136978:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1787779571.136984:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ebf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+19:3304:x1874622524999040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779571.137012:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ebf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+19:3304:x1874622524999040:12345-0@lo:400:kworker.0 Request processed in 28us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779571.137018:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1787779571.137043:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524999552 00000100:00100000:2.0:1787779571.137046:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524999552 00000100:00100000:2.0:1787779571.137069:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524999168 00000100:00100000:2.0:1787779571.137072:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524999168 00000100:00100000:2.0:1787779571.137082:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524999296 00000100:00100000:2.0:1787779571.137084:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524999296 00000100:00100000:2.0:1787779571.137097:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787779571.137103:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e848f37c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874622524999552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779571.137131:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e848f37c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874622524999552:12345-0@lo:400:kworker.0 Request processed in 28us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779571.137136:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787779571.137148:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787779571.137154:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e848f34b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874622524999168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779571.137176:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e848f34b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874622524999168:12345-0@lo:400:kworker.0 Request processed in 24us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779571.137182:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787779571.137193:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787779571.137198:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e848f35a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874622524999296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779571.137222:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e848f35a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874622524999296:12345-0@lo:400:kworker.0 Request processed in 25us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779571.137237:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:2.0:1787779571.137265:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787779571.137269:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787779571.137304:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e848f34780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874622524999296:0@lo:400:kworker.0 00000100:00100000:2.0:1787779571.137315:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e848f370c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874622524999168:0@lo:400:kworker.0 00010000:00080000:2.0:1787779571.137326:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e848f36580 x1874622524999680/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779587 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779571.137336:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e848f36580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622524999680:0@lo:400:kworker.0 00000100:00100000:2.0:1787779571.137363:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f538f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c28aae66-2825-42c5-8f52-61f687e868c9:3304:1874622524999040:0@lo:400:kworker.0 00000100:00100000:2.0:1787779571.137372:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e848f36d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874622524999552:0@lo:400:kworker.0 00010000:00080000:2.0:1787779571.137382:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e848f34000 x1874622524999424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779587 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779571.137390:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e848f34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874622524999424:0@lo:400:kworker.0 00010000:00010000:2.0:1787779571.315019:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787779571.636258:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ec18f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622524999808:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787779571.636336:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779571.644147:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524999808 00000100:00100000:1.0:1787779571.644161:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524999808 00000100:00100000:1.0:1787779571.644228:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787779571.644237:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e848f34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622524999808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787779571.644292:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787779571.644376:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e848f34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622524999808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 140us (8040us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779571.644383:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:3.0:1787779571.644598:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e87ec18f00 x1874622524999808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779587 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779571.644618:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ec18f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622524999808:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787779572.347742:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787779572.827347:0:11012:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1787779573.363491:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779573.407527:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779573.407632:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779573.407774:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779573.408095:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505040384 00000100:00100000:2.0:1787779573.408105:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505040384 00000100:00100000:2.0:1787779573.408161:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 232 00000100:00100000:2.0:1787779573.408172:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ebf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+13:2358:x1874622505040384:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:2.0:1787779573.408244:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ebf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+13:2358:x1874622505040384:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 74us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779573.408265:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 232 00000100:00100000:0.0:1787779573.409242:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505040640 00000100:00100000:0.0:1787779573.409249:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505040640 00000100:00100000:0.0:1787779573.409301:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505040512 00000100:00100000:0.0:1787779573.409304:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505040512 00000100:00100000:0.0:1787779573.409328:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 94 00000100:00100000:0.0:1787779573.409335:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87aa30f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54e1e60c-3037-4ae3-b045-838eb9e0ad0b+5:2358:x1874622505040640:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:0.0:1787779573.409380:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87aa30f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54e1e60c-3037-4ae3-b045-838eb9e0ad0b+5:2358:x1874622505040640:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 46us (1748us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779573.409388:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 94 00000100:00100000:0.0:1787779573.409404:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 95 00000100:00100000:0.0:1787779573.409410:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87aa303c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:2358:x1874622505040512:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:0.0:1787779573.409447:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87aa303c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:2358:x1874622505040512:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 36us (1684us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779573.409453:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 95 00000100:00080000:3.0:1787779573.410544:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787779574.388055:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779575.224628:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787779575.224652:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87aa33c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874622524999936:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787779575.228658:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779575.230829:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622524999936 00000100:00100000:1.0:1787779575.230843:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622524999936 00000100:00100000:1.0:1787779575.230907:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787779575.230916:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87fd28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874622524999936:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787779575.231049:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1787779575.231106:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787779575.231196:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87fd28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874622524999936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 280us (2546us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779575.231204:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:3.0:1787779575.231302:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e87aa33c00 x1874622524999936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779591 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779575.231322:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87aa33c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874622524999936:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787779575.411884:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779576.243045:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e88195c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c28aae66-2825-42c5-8f52-61f687e868c9:3305:1874622525000064:0@lo:400:kworker.0 00000100:00100000:1.0:1787779576.243045:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e88195f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874622525000192:0@lo:400:kworker.0 00000100:00100000:2.0:1787779576.243170:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e88195c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874622525000448:0@lo:400:kworker.0 00000100:00100000:0.0:1787779576.248097:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e88195d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874622525000320:0@lo:400:kworker.0 00000100:00100000:0.0:1787779576.248815:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779576.248898:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525000320 00000100:00100000:0.0:1787779576.248906:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525000320 00000100:00100000:0.0:1787779576.248962:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787779576.248986:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874622525000320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779576.249044:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874622525000320:12345-0@lo:400:kworker.0 Request processed in 60us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779576.249051:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787779576.249096:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e88195d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874622525000320:0@lo:400:kworker.0 00000100:00100000:3.0:1787779576.249569:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779576.249605:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e88195cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874622525000576:0@lo:400:kworker.0 00000100:00100000:3.0:1787779576.249631:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787779576.249660:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787779576.249671:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525000576 00000100:00100000:3.0:1787779576.249675:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525000576 00000100:00100000:3.0:1787779576.249708:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787779576.249742:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87fd2b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874622525000576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779576.249859:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87fd2b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874622525000576:12345-0@lo:400:kworker.0 Request processed in 118us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779576.249866:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:3.0:1787779576.249882:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787779576.249900:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e88195cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874622525000576:0@lo:400:kworker.0 00000100:00100000:1.0:1787779576.250136:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779576.250166:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e88195f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622525000704:0@lo:400:kworker.0 00000100:00100000:0.0:1787779576.250449:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525000064 00000100:00100000:0.0:1787779576.250454:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525000064 00000100:00100000:0.0:1787779576.250486:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1787779576.250494:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ebe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+19:3305:x1874622525000064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779576.251069:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525000192 00000100:00100000:3.0:1787779576.251073:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525000192 00000100:00100000:3.0:1787779576.251103:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787779576.251108:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e88195e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874622525000192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779576.257477:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779576.257620:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e88195e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874622525000192:12345-0@lo:400:kworker.0 Request processed in 6509us (7481us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779576.257633:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787779576.257757:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e88195f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874622525000192:0@lo:400:kworker.0 00000100:00100000:3.0:1787779576.259902:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525000704 00000100:00100000:3.0:1787779576.259916:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525000704 00000100:00100000:3.0:1787779576.260037:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787779576.260047:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e88195da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622525000704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779576.260134:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e88195da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622525000704:12345-0@lo:400:kworker.0 Request processed in 89us (2669us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779576.260141:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:1.0:1787779576.260205:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787779576.260240:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e88195f480 x1874622525000704/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779592 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779576.260254:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e88195f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622525000704:0@lo:400:kworker.0 00000100:00100000:2.0:1787779576.263247:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779576.263319:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ebe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+19:3305:x1874622525000064:12345-0@lo:400:kworker.0 Request processed in 12822us (13747us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779576.263332:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1787779576.264189:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e88195c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c28aae66-2825-42c5-8f52-61f687e868c9:3305:1874622525000064:0@lo:400:kworker.0 00000100:00100000:3.0:1787779576.264689:0:10229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525000448 00000100:00100000:3.0:1787779576.264697:0:10229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525000448 00000100:00100000:3.0:1787779576.264772:0:10229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787779576.264781:0:10229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e848f370c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874622525000448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779576.264874:0:10229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e848f370c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874622525000448:12345-0@lo:400:kworker.0 Request processed in 94us (1635us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779576.264959:0:10229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:1.0:1787779576.265059:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e88195c3c0 x1874622525000448/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779592 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779576.265085:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e88195c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874622525000448:0@lo:400:kworker.0 00010000:00010000:1.0:1787779576.435058:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779576.755104:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ec18f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622525000832:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787779576.755175:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779576.755350:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525000832 00000100:00100000:0.0:1787779576.755358:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525000832 00000100:00100000:0.0:1787779576.755414:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787779576.755423:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e88195c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622525000832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787779576.755458:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787779576.755504:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e88195c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622525000832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779576.755511:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:0.0:1787779576.755549:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e87ec18f00 x1874622525000832/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779592 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779576.755566:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ec18f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622525000832:0@lo:13:osp-pre-1-0.0 00000020:00000080:3.0:1787779577.017315:0:11160:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffc886a710 20000000:00000080:3.0:1787779577.017335:0:11160:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98e873974400 uarg=0000000000000000 20000000:01000000:3.0:1787779577.017437:0:11160:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787779577.017444:0:11160:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787779577.017449:0:11160:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1787779577.024035:0:11161:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1787779577.029206:0:11160:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787779577.045818:0:11160:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787779577.051137:0:11160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98e848f68800/0x9e63ba8af6889040 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779577.051183:0:11160:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98e841649c00/0x9e63ba8af6888fe5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedab7d expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779577.051191:0:11160:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98e8429d5c00/0x9e63ba8af6888ff3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af6888fec expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779577.051198:0:11160:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98e841649e00/0x9e63ba8af6889001 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af6888ffa expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779577.051205:0:11160:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98e87aa66800/0x9e63ba8af688900f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af6889008 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779577.051212:0:11160:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98e87a98a200/0x9e63ba8af6889024 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedabb5 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779577.051219:0:11160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98e848f68800/0x9e63ba8af6889040 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779577.051271:0:11160:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98e87a98a200/0x9e63ba8af6889024 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedabb5 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779577.051298:0:11160:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98e87a98a200/0x9e63ba8af6889024 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedabb5 expref: 12 pid: 5831 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779577.051314:0:11160:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ec1b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11160:1874622525000960:192.168.201.9@tcp:104: 00010000:00010000:0.0:1787779577.051432:0:11160:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98e87aa66800/0x9e63ba8af688900f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9e63ba8af6889008 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779577.051441:0:11160:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98e87aa66800/0x9e63ba8af688900f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9e63ba8af6889008 expref: 18 pid: 5828 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779577.051456:0:11160:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ec1b840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11160:1874622525001088:0@lo:104: 00000100:00100000:0.0:1787779577.051499:0:11160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787779577.051542:0:11160:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98e841649e00/0x9e63ba8af6889001 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9e63ba8af6888ffa expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779577.051550:0:11160:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98e841649e00/0x9e63ba8af6889001 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9e63ba8af6888ffa expref: 18 pid: 5830 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779577.051558:0:11160:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855b3f840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11160:1874622525001216:0@lo:104: 00000100:00100000:0.0:1787779577.051579:0:11160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787779577.051603:0:11160:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98e8429d5c00/0x9e63ba8af6888ff3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9e63ba8af6888fec expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779577.051611:0:11160:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98e8429d5c00/0x9e63ba8af6888ff3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9e63ba8af6888fec expref: 18 pid: 5828 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779577.051618:0:11160:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855b3e1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11160:1874622525001344:0@lo:104: 00000100:00100000:0.0:1787779577.051638:0:11160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787779577.051653:0:11160:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98e841649c00/0x9e63ba8af6888fe5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedab7d expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779577.051661:0:11160:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98e841649c00/0x9e63ba8af6888fe5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedab7d expref: 12 pid: 5830 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779577.051669:0:11160:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855b3cf00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11160:1874622525001472:192.168.201.9@tcp:104: 00000100:00100000:0.0:1787779577.051728:0:11160:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e87eb46240 going to sleep for 11 seconds 00000100:00100000:0.0:1787779577.051764:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525001088 00000100:00100000:0.0:1787779577.051784:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525001088 00000100:00100000:0.0:1787779577.051839:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525001216 00000100:00100000:0.0:1787779577.051850:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525001216 00000100:00100000:0.0:1787779577.051863:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525001344 00000100:00100000:0.0:1787779577.051865:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525001344 00000100:00100000:0.0:1787779577.051878:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787779577.051886:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec18780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c28aae66-2825-42c5-8f52-61f687e868c9+5:11160:x1874622525001088:12345-0@lo:104: 00010000:00010000:0.0:1787779577.051897:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.109@tcp lock: ffff98e841649600/0x9e63ba8af6889008 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9e63ba8af688900f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779577.052075:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787779577.052081:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec18780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c28aae66-2825-42c5-8f52-61f687e868c9+5:11160:x1874622525001088:12345-0@lo:104: Request processed in 196us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779577.052088:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787779577.052096:0:11160:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ec1b840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11160:1874622525001088:0@lo:104: 00000100:00100000:0.0:1787779577.052106:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787779577.052112:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e855b3f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c28aae66-2825-42c5-8f52-61f687e868c9+4:11160:x1874622525001216:12345-0@lo:104: 00010000:00010000:0.0:1787779577.052120:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.109@tcp lock: ffff98e841648600/0x9e63ba8af6888ffa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9e63ba8af6889001 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779577.052164:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787779577.052169:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e855b3f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c28aae66-2825-42c5-8f52-61f687e868c9+4:11160:x1874622525001216:12345-0@lo:104: Request processed in 58us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779577.052174:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787779577.052186:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787779577.052191:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e855b3d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c28aae66-2825-42c5-8f52-61f687e868c9+3:11160:x1874622525001344:12345-0@lo:104: 00010000:00010000:0.0:1787779577.052197:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.109@tcp lock: ffff98e848f68400/0x9e63ba8af6888fec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9e63ba8af6888ff3 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779577.052227:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787779577.052237:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e855b3d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c28aae66-2825-42c5-8f52-61f687e868c9+3:11160:x1874622525001344:12345-0@lo:104: Request processed in 46us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779577.052243:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787779577.052251:0:11160:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855b3f840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11160:1874622525001216:0@lo:104: 00010000:00010000:0.0:1787779577.052258:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:2.0:1787779577.052259:0:11160:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855b3e1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11160:1874622525001344:0@lo:104: 00010000:00010000:0.0:1787779577.052264:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff98e841649600/0x9e63ba8af6889008 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9e63ba8af688900f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779577.052272:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e841649600 already unused, calling callback (ffffffffc1cd5c20) 10000000:00010000:0.0:1787779577.052276:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff98e841649600/0x9e63ba8af6889008 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9e63ba8af688900f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779577.052285:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff98e841649600/0x9e63ba8af6889008 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9e63ba8af688900f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787779577.052291:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff98e841649600/0x9e63ba8af6889008 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9e63ba8af688900f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787779577.052297:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787779577.052329:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.109@tcp lock: ffff98e841649600/0x9e63ba8af6889008 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af688900f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779577.052337:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787779577.052356:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff98e841649600/0x9e63ba8af6889008 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af688900f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779577.052362:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff98e841649600/0x9e63ba8af6889008 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af688900f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779577.052375:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787779577.052378:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff98e841648600/0x9e63ba8af6888ffa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9e63ba8af6889001 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779577.052394:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e841648600 already unused, calling callback (ffffffffc1cd5c20) 10000000:00010000:0.0:1787779577.052397:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff98e841648600/0x9e63ba8af6888ffa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9e63ba8af6889001 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779577.052403:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff98e841648600/0x9e63ba8af6888ffa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9e63ba8af6889001 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787779577.052409:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff98e841648600/0x9e63ba8af6888ffa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9e63ba8af6889001 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787779577.052414:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787779577.052429:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.109@tcp lock: ffff98e841648600/0x9e63ba8af6888ffa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af6889001 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779577.052435:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787779577.052441:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff98e841648600/0x9e63ba8af6888ffa lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af6889001 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779577.052447:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff98e841648600/0x9e63ba8af6888ffa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af6889001 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779577.052457:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787779577.052460:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff98e848f68400/0x9e63ba8af6888fec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9e63ba8af6888ff3 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779577.052466:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e848f68400 already unused, calling callback (ffffffffc1cd5c20) 10000000:00010000:0.0:1787779577.052468:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff98e848f68400/0x9e63ba8af6888fec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9e63ba8af6888ff3 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779577.052485:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff98e848f68400/0x9e63ba8af6888fec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9e63ba8af6888ff3 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787779577.052490:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff98e848f68400/0x9e63ba8af6888fec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9e63ba8af6888ff3 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787779577.052495:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787779577.052519:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.109@tcp lock: ffff98e848f68400/0x9e63ba8af6888fec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af6888ff3 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779577.052525:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787779577.052540:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff98e848f68400/0x9e63ba8af6888fec lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af6888ff3 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779577.052547:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff98e848f68400/0x9e63ba8af6888fec lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af6888ff3 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779577.052561:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779577.052563:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779577.052564:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779577.052570:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779577.052575:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779577.052586:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855b3d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c28aae66-2825-42c5-8f52-61f687e868c9:3304:1874622525001600:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787779577.052627:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779577.052654:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787779577.052659:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87aa561c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c28aae66-2825-42c5-8f52-61f687e868c9:3304:1874622525001728:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787779577.052678:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779577.053862:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525001600 00000100:00100000:2.0:1787779577.053879:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525001600 00010000:00010000:2.0:1787779577.053914:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98e87aa66800/0x9e63ba8af688900f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9e63ba8af6889008 expref: 19 pid: 5828 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779577.063404:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525001728 00000100:00100000:2.0:1787779577.063418:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525001728 00010000:00010000:2.0:1787779577.063478:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98e841649e00/0x9e63ba8af6889001 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9e63ba8af6888ffa expref: 20 pid: 5830 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779577.063504:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787779577.063513:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e847d94450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c28aae66-2825-42c5-8f52-61f687e868c9+20:3304:x1874622525001600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787779577.063527:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787779577.063533:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98e87aa66800/0x9e63ba8af688900f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9e63ba8af6889008 expref: 20 pid: 5828 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779577.063544:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98e87aa66800/0x9e63ba8af688900f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9e63ba8af6889008 expref: 20 pid: 5828 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779577.063562:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e87aa66800/0x9e63ba8af688900f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9e63ba8af6889008 expref: 20 pid: 5828 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779577.063595:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787779577.063763:0:5822:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1787779577.063785:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1787779577.063947:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87aa56940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c28aae66-2825-42c5-8f52-61f687e868c9:3306:1874622525001856:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787779577.063991:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779577.064048:0:5821:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1787779577.064057:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525001856 00000100:00100000:0.0:1787779577.064060:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525001856 00010000:00010000:0.0:1787779577.064076:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98e8429d5c00/0x9e63ba8af6888ff3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9e63ba8af6888fec expref: 20 pid: 5828 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779577.064089:0:5821:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1787779577.064095:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787779577.064101:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87aa54780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c28aae66-2825-42c5-8f52-61f687e868c9+20:3304:x1874622525001728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787779577.064109:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787779577.064113:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98e841649e00/0x9e63ba8af6889001 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9e63ba8af6888ffa expref: 20 pid: 5830 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779577.064121:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98e841649e00/0x9e63ba8af6889001 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9e63ba8af6888ffa expref: 20 pid: 5830 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779577.064131:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e841649e00/0x9e63ba8af6889001 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9e63ba8af6888ffa expref: 20 pid: 5830 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779577.064142:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787779577.064168:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87aa54780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c28aae66-2825-42c5-8f52-61f687e868c9+19:3304:x1874622525001728:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (11488us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779577.064175:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787779577.064190:0:5821:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1787779577.064196:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787779577.064201:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87aa57840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c28aae66-2825-42c5-8f52-61f687e868c9+18:3306:x1874622525001856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787779577.064209:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787779577.064220:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98e8429d5c00/0x9e63ba8af6888ff3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9e63ba8af6888fec expref: 18 pid: 5828 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779577.064229:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98e8429d5c00/0x9e63ba8af6888ff3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9e63ba8af6888fec expref: 18 pid: 5828 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779577.064238:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e8429d5c00/0x9e63ba8af6888ff3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9e63ba8af6888fec expref: 18 pid: 5828 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779577.064247:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787779577.064275:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87aa57840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c28aae66-2825-42c5-8f52-61f687e868c9+17:3306:x1874622525001856:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779577.064281:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787779577.064315:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87aa56940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c28aae66-2825-42c5-8f52-61f687e868c9:3306:1874622525001856:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787779577.065223:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e847d94450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c28aae66-2825-42c5-8f52-61f687e868c9+16:3304:x1874622525001600:12345-0@lo:103:ldlm_bl.0 Request processed in 1708us (12592us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779577.065234:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787779577.067069:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779577.067095:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779577.067119:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505040768 00000100:00100000:3.0:1787779577.067126:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505040768 00010000:00010000:3.0:1787779577.067168:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98e87a98a200/0x9e63ba8af6889024 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedabb5 expref: 13 pid: 5831 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779577.067193:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505040896 00000100:00100000:3.0:1787779577.067196:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505040896 00010000:00010000:3.0:1787779577.067207:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98e841649c00/0x9e63ba8af6888fe5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedab7d expref: 14 pid: 5830 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779577.067221:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 28 00000100:00100000:3.0:1787779577.067281:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87fd28b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+14:2360:x1874622505040768:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787779577.067297:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787779577.067303:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98e87a98a200/0x9e63ba8af6889024 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedabb5 expref: 14 pid: 5831 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779577.067315:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98e87a98a200/0x9e63ba8af6889024 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedabb5 expref: 14 pid: 5831 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779577.067334:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787779577.067382:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87fd28b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+14:2360:x1874622505040768:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 153us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779577.067408:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 28 00000100:00100000:3.0:1787779577.067424:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 29 00000100:00100000:3.0:1787779577.067431:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87fd2ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+13:2360:x1874622505040896:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787779577.067440:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787779577.067444:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98e841649c00/0x9e63ba8af6888fe5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedab7d expref: 13 pid: 5830 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779577.067454:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98e841649c00/0x9e63ba8af6888fe5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedab7d expref: 13 pid: 5830 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779577.067467:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98e848f68800/0x9e63ba8af6889040 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779577.067475:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e848f68800/0x9e63ba8af6889040 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779577.067490:0:5821:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98e848f68800/0x9e63ba8af6889040 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779577.067497:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98e848f68800/0x9e63ba8af6889040 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779577.067504:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98e848f68800/0x9e63ba8af6889040 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779577.067509:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98e848f68800/0x9e63ba8af6889040 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779577.067515:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e848f68800 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:3.0:1787779577.067533:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98e848f68800/0x9e63ba8af6889040 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779577.067541:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98e848f68800/0x9e63ba8af6889040 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779577.067549:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98e848f68800/0x9e63ba8af6889040 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779577.067559:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787779577.067577:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87fd2ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+13:2360:x1874622505040896:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 146us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779577.067584:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 29 00010000:00010000:2.0:1787779577.067864:0:11160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e87a98a200/0x9e63ba8af6889024 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedabb5 expref: 12 pid: 5831 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779577.067891:0:11160:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ec1b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11160:1874622525000960:192.168.201.9@tcp:104: 00010000:00010000:2.0:1787779577.067904:0:11160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e841649c00/0x9e63ba8af6888fe5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedab7d expref: 11 pid: 5830 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779577.067913:0:11160:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855b3cf00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11160:1874622525001472:192.168.201.9@tcp:104: 00010000:00010000:2.0:1787779577.067962:0:11160:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98e848f68800/0x9e63ba8af6889040 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779577.067972:0:11160:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98e848f68800/0x9e63ba8af6889040 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779577.067979:0:11160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98e848f68800/0x9e63ba8af6889040 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779577.069368:0:11160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e848f68800/0x9e63ba8af6889040 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779577.075276:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87aa561c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c28aae66-2825-42c5-8f52-61f687e868c9:3304:1874622525001728:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787779577.075291:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855b3d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c28aae66-2825-42c5-8f52-61f687e868c9:3304:1874622525001600:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787779577.463392:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779578.483416:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779578.541002:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779578.541076:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779578.541109:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779578.541143:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505041024 00000100:00100000:2.0:1787779578.541152:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505041024 00000100:00100000:2.0:1787779578.541208:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 234 00000100:00100000:2.0:1787779578.541217:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ebd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+11:2358:x1874622505041024:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:2.0:1787779578.541314:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ebd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+11:2358:x1874622505041024:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 98us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779578.541321:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 234 00000100:00100000:1.0:1787779578.552215:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505041152 00000100:00100000:1.0:1787779578.552229:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505041152 00000100:00100000:1.0:1787779578.552391:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505041280 00000100:00100000:1.0:1787779578.552395:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505041280 00000100:00100000:0.0:1787779578.554467:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 99 00000100:00100000:0.0:1787779578.554486:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87fd2bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:2358:x1874622505041152:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:0.0:1787779578.554574:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87fd2bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:2358:x1874622505041152:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 96us (13580us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779578.554582:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 99 00000100:00080000:3.0:1787779578.554953:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787779578.558882:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 100 00000100:00100000:1.0:1787779578.558898:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87aa33c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54e1e60c-3037-4ae3-b045-838eb9e0ad0b+5:2358:x1874622505041280:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:1.0:1787779578.558984:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87aa33c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54e1e60c-3037-4ae3-b045-838eb9e0ad0b+5:2358:x1874622505041280:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 90us (17873us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779578.558991:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 100 10000000:01000000:2.0:1787779578.866945:0:5833:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787779578.866953:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98e87a56c800 from 7 10000000:01000000:2.0:1787779578.866958:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787779578.867002:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e87aa66000/0x9e63ba8af6889047 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779578.867014:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff98e87aa66000/0x9e63ba8af6889047 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779578.867026:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff98e87aa66000/0x9e63ba8af6889047 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779578.867050:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e848f361c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622525001984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787779578.867116:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779578.867166:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e841377a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787779578.867213:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525001984 00000100:00100000:0.0:1787779578.867220:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525001984 00000100:00100000:0.0:1787779578.867273:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1787779578.867294:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ebe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+16:5833:x1874622525001984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787779578.867309:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787779578.867324:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e848f68400/0x9e63ba8af688904e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9e63ba8af6889047 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779578.867370:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e848f68400/0x9e63ba8af688904e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9e63ba8af6889047 expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779578.867381:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e848f68400/0x9e63ba8af688904e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af6889047 expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779578.867391:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e848f68400, rc 0) 00000100:00100000:0.0:1787779578.867450:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ebe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+17:5833:x1874622525001984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 169us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779578.867456:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1787779578.867858:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e848f361c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622525001984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787779578.867874:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff98e87aa66000/0x9e63ba8af6889047 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af688904e expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779578.867882:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff98e87aa66000/0x9e63ba8af6889047 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9e63ba8af688904e expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779578.867943:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e88195c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622525002112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787779578.867972:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779578.867996:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e85f57c000 going to sleep for 11 seconds 00000100:00100000:2.0:1787779578.869426:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525002112 00000100:00100000:2.0:1787779578.869435:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525002112 00000100:00100000:2.0:1787779578.869480:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1787779578.869490:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ebd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+17:5833:x1874622525002112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787779578.869791:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ebd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+17:5833:x1874622525002112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 302us (1818us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779578.869798:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1787779578.871545:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e88195c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622525002112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787779578.871607:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e88195c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622525002240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787779578.871699:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779578.871753:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e85f57c000 going to sleep for 11 seconds 00000100:00100000:2.0:1787779578.872589:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525002240 00000100:00100000:2.0:1787779578.872597:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525002240 00000100:00100000:2.0:1787779578.872657:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1787779578.872683:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ebc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+17:5833:x1874622525002240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787779578.873158:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ebc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+17:5833:x1874622525002240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 476us (1458us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779578.873167:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1787779578.873997:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e88195c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622525002240:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787779578.875209:0:11195:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787779578.876840:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787779578.877056:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787779578.877069:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e87aa66000/0x9e63ba8af6889047 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af688904e expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779578.877091:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff98e87aa66000/0x9e63ba8af6889047 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af688904e expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787779578.877101:0:5833:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787779578.877104:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98e848ee5800 from 7 10000000:01000000:2.0:1787779578.877107:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787779578.877142:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e87aa67800/0x9e63ba8af6889055 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779578.877149:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff98e87aa67800/0x9e63ba8af6889055 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779578.877161:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff98e87aa67800/0x9e63ba8af6889055 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779578.877183:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e848f343c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622525002368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787779578.877263:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779578.877312:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e742bd1b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787779578.877331:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525002368 00000100:00100000:2.0:1787779578.877337:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525002368 00000100:00100000:2.0:1787779578.877398:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1787779578.877406:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ebf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+17:5833:x1874622525002368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787779578.877420:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779578.877434:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e87aa66200/0x9e63ba8af688905c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9e63ba8af6889055 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779578.877466:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e87aa66200/0x9e63ba8af688905c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9e63ba8af6889055 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779578.877478:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e87aa66200/0x9e63ba8af688905c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af6889055 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779578.877497:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87aa66200, rc 0) 00000100:00100000:2.0:1787779578.877535:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ebf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+18:5833:x1874622525002368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779578.877541:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1787779578.877584:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e848f343c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622525002368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787779578.877597:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff98e87aa67800/0x9e63ba8af6889055 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af688905c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779578.877605:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff98e87aa67800/0x9e63ba8af6889055 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9e63ba8af688905c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779578.877673:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e848f343c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622525002496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787779578.877699:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779578.877738:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e742bd1b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787779578.877751:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525002496 00000100:00100000:2.0:1787779578.877755:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525002496 00000100:00100000:2.0:1787779578.877783:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1787779578.877789:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ebe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+18:5833:x1874622525002496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787779578.881842:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ebe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+18:5833:x1874622525002496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 4043us (4133us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779578.882575:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e848f343c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622525002496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787779578.882647:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e88195c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622525002624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787779578.882708:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779578.882758:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e85f57c000 going to sleep for 11 seconds 00000100:00100000:2.0:1787779578.883018:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1787779578.883051:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525002624 00000100:00100000:2.0:1787779578.883056:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525002624 00000100:00100000:2.0:1787779578.883084:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1787779578.883091:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ebec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+18:5833:x1874622525002624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787779578.883285:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ebec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+18:5833:x1874622525002624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 184us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779578.883293:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1787779578.884028:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e88195c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622525002624:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787779578.893083:0:11196:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787779578.895553:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787779578.895584:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787779578.895595:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e87aa67800/0x9e63ba8af6889055 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af688905c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779578.895607:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff98e87aa67800/0x9e63ba8af6889055 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af688905c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787779578.895629:0:5833:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787779578.895631:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98e846b05800 from 7 10000000:01000000:2.0:1787779578.895635:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787779578.895682:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e87aa66400/0x9e63ba8af6889063 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779578.895690:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff98e87aa66400/0x9e63ba8af6889063 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779578.895733:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff98e87aa66400/0x9e63ba8af6889063 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779578.895760:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e848f34f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622525002752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787779578.895823:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779578.896382:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e742bd10c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787779578.901961:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525002752 00000100:00100000:3.0:1787779578.901976:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525002752 00000100:00100000:3.0:1787779578.902031:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1787779578.902040:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ebc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+18:5833:x1874622525002752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787779578.902057:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779578.902075:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e8429d5800/0x9e63ba8af688906a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9e63ba8af6889063 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779578.902103:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e8429d5800/0x9e63ba8af688906a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9e63ba8af6889063 expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779578.902114:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e8429d5800/0x9e63ba8af688906a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af6889063 expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779578.902134:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e8429d5800, rc 0) 00000100:00100000:3.0:1787779578.902208:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ebc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+19:5833:x1874622525002752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 169us (6385us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779578.902214:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1787779578.902264:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e848f34f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622525002752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787779578.902291:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff98e87aa66400/0x9e63ba8af6889063 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af688906a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779578.902300:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff98e87aa66400/0x9e63ba8af6889063 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9e63ba8af688906a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779578.902390:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e851681e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622525002880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787779578.902424:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779578.902593:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e852bfdb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787779578.903356:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525002880 00000100:00100000:2.0:1787779578.903372:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525002880 00000100:00100000:2.0:1787779578.903407:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1787779578.903415:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ebd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+19:5833:x1874622525002880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787779578.903910:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ebd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+19:5833:x1874622525002880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 494us (1484us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779578.903919:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1787779578.907782:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e851681e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622525002880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787779578.912117:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e851681e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622525003008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787779578.912210:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779578.912248:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e852bfdb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787779578.912271:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525003008 00000100:00100000:3.0:1787779578.912278:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525003008 00000100:00100000:3.0:1787779578.912322:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1787779578.912330:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+19:5833:x1874622525003008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787779578.913218:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779578.913243:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505041408 00000100:00100000:2.0:1787779578.913249:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505041408 00000100:00100000:2.0:1787779578.913277:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 244 00000100:00100000:2.0:1787779578.913284:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+11:5601:x1874622505041408:12345-192.168.201.9@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787779578.913298:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779578.913319:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e87aa67200/0x9e63ba8af6889071 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedabdf expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779578.913347:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e87aa67200/0x9e63ba8af6889071 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedabdf expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779578.913372:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e87aa67200/0x9e63ba8af6889071 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedabdf expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779578.913388:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87aa67200, rc 0) 00000100:00100000:2.0:1787779578.913458:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+12:5601:x1874622505041408:12345-192.168.201.9@tcp:101:ll_cfg_requeue.0 Request processed in 174us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779578.913466:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 244 00000100:00100000:3.0:1787779578.922886:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+19:5833:x1874622525003008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 10545us (10665us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779578.922921:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1787779578.924685:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e851681e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622525003008:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787779578.929147:0:11199:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787779578.929478:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787779578.929500:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787779578.929512:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e87aa66400/0x9e63ba8af6889063 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af688906a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779578.929524:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff98e87aa66400/0x9e63ba8af6889063 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af688906a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779578.933023:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779578.933100:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505041536 00000100:00100000:3.0:1787779578.933110:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505041536 00000100:00100000:3.0:1787779578.933166:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 245 00000100:00100000:3.0:1787779578.933175:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+12:5601:x1874622505041536:12345-192.168.201.9@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787779578.933470:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+12:5601:x1874622505041536:12345-192.168.201.9@tcp:501:ll_cfg_requeue.0 Request processed in 294us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779578.933479:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 245 00000100:00100000:0.0:1787779578.936574:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779578.938482:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505041664 00000100:00100000:3.0:1787779578.938495:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505041664 00000100:00100000:3.0:1787779578.938561:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 246 00000100:00100000:3.0:1787779578.938572:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+12:5601:x1874622505041664:12345-192.168.201.9@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787779578.939544:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+12:5601:x1874622505041664:12345-192.168.201.9@tcp:503:ll_cfg_requeue.0 Request processed in 969us (2974us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779578.939554:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 246 00000100:00100000:2.0:1787779578.986250:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779578.986430:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505041792 00000100:00100000:1.0:1787779578.986448:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505041792 00000100:00100000:1.0:1787779578.986499:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 247 00000100:00100000:1.0:1787779578.986509:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+12:5601:x1874622505041792:12345-192.168.201.9@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787779578.986526:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779578.986543:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e87a98ae00/0x9e63ba8af6889078 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedabe6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779578.986581:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e87a98ae00/0x9e63ba8af6889078 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedabe6 expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779578.986593:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e87a98ae00/0x9e63ba8af6889078 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedabe6 expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779578.986602:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87a98ae00, rc 0) 00000100:00100000:1.0:1787779578.986656:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+13:5601:x1874622505041792:12345-192.168.201.9@tcp:101:ll_cfg_requeue.0 Request processed in 148us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779578.986671:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 247 00000100:00100000:0.0:1787779578.993185:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779578.993324:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505041920 00000100:00100000:3.0:1787779578.993335:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505041920 00000100:00100000:3.0:1787779578.993394:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 248 00000100:00100000:3.0:1787779578.993418:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+13:5601:x1874622505041920:12345-192.168.201.9@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787779578.994048:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+13:5601:x1874622505041920:12345-192.168.201.9@tcp:501:ll_cfg_requeue.0 Request processed in 629us (869us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779578.994057:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 248 00000100:00100000:1.0:1787779579.014066:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779579.014162:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505042048 00000100:00100000:3.0:1787779579.014172:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505042048 00000100:00100000:3.0:1787779579.014223:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 249 00000100:00100000:3.0:1787779579.014233:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+13:5601:x1874622505042048:12345-192.168.201.9@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787779579.014466:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+13:5601:x1874622505042048:12345-192.168.201.9@tcp:503:ll_cfg_requeue.0 Request processed in 234us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779579.014475:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 249 00010000:00010000:2.0:1787779579.507685:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779580.354850:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87aa56940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622525003136:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787779580.354921:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779580.354995:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525003136 00000100:00100000:0.0:1787779580.355002:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525003136 00000100:00100000:0.0:1787779580.355054:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787779580.355073:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87aa552c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622525003136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787779580.355108:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787779580.355150:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87aa552c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622525003136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779580.355157:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:0.0:1787779580.355211:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e87aa56940 x1874622525003136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779596 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779580.355229:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87aa56940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622525003136:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787779580.358035:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787779580.533191:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787779581.363408:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e848f37840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874622525003520:0@lo:400:kworker.0 00000100:00100000:2.0:1787779581.363477:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779581.363536:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787779581.363542:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e848f34f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622525003648:0@lo:400:kworker.0 00000100:00100000:2.0:1787779581.363569:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779581.363609:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525003520 00000100:00100000:2.0:1787779581.363616:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525003520 00000100:00100000:2.0:1787779581.363684:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787779581.363694:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e848f36580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874622525003520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779581.363802:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e848f36580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874622525003520:12345-0@lo:400:kworker.0 Request processed in 110us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779581.363810:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787779581.363835:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525003648 00000100:00100000:2.0:1787779581.363838:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525003648 00000100:00100000:2.0:1787779581.363860:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787779581.363867:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e848f36d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622525003648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779581.363898:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e848f36d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622525003648:12345-0@lo:400:kworker.0 Request processed in 31us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779581.363904:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:2.0:1787779581.363931:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787779581.363962:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e848f34f00 x1874622525003648/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779597 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779581.363978:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e848f34f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622525003648:0@lo:400:kworker.0 00000100:00100000:2.0:1787779581.363990:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e848f37840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874622525003520:0@lo:400:kworker.0 00000100:00100000:0.0:1787779581.364077:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e848f352c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c28aae66-2825-42c5-8f52-61f687e868c9:3304:1874622525003264:0@lo:400:kworker.0 00000100:00100000:0.0:1787779581.364114:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779581.364148:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e848f343c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874622525003776:0@lo:400:kworker.0 00000100:00100000:0.0:1787779581.364170:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779581.364191:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787779581.364197:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e848f36940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874622525003392:0@lo:400:kworker.0 00000100:00100000:0.0:1787779581.364218:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779581.364235:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e848f361c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874622525003904:0@lo:400:kworker.0 00000100:00100000:0.0:1787779581.364255:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779581.364278:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525003776 00000100:00100000:0.0:1787779581.364282:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525003776 00000100:00100000:0.0:1787779581.364307:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525003392 00000100:00100000:0.0:1787779581.364310:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525003392 00000100:00100000:0.0:1787779581.364325:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787779581.364332:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87aa56940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874622525003776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779581.364366:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87aa56940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874622525003776:12345-0@lo:400:kworker.0 Request processed in 34us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779581.364373:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787779581.364387:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787779581.364392:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87aa54f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874622525003392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779581.364417:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87aa54f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874622525003392:12345-0@lo:400:kworker.0 Request processed in 25us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779581.364434:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787779581.364467:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e848f36940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874622525003392:0@lo:400:kworker.0 00000100:00100000:0.0:1787779581.364476:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e848f343c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874622525003776:0@lo:400:kworker.0 00000100:00100000:3.0:1787779581.364618:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525003904 00000100:00100000:3.0:1787779581.364635:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525003904 00000100:00100000:3.0:1787779581.364673:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787779581.364681:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87aa561c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874622525003904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779581.364737:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87aa561c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874622525003904:12345-0@lo:400:kworker.0 Request processed in 57us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779581.364743:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:3.0:1787779581.364769:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e848f361c0 x1874622525003904/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779597 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779581.364779:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e848f361c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874622525003904:0@lo:400:kworker.0 00000100:00100000:2.0:1787779581.364939:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525003264 00000100:00100000:2.0:1787779581.364943:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525003264 00000100:00100000:2.0:1787779581.365006:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1787779581.365013:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+19:3304:x1874622525003264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779581.365056:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+19:3304:x1874622525003264:12345-0@lo:400:kworker.0 Request processed in 44us (941us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779581.365062:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1787779581.365115:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e848f352c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c28aae66-2825-42c5-8f52-61f687e868c9:3304:1874622525003264:0@lo:400:kworker.0 00000100:00080000:3.0:1787779581.369996:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787779581.370006:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787779581.566599:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779581.875935:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855b02580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622525004032:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787779581.876051:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779581.876169:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525004032 00000100:00100000:0.0:1787779581.876178:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525004032 00000100:00100000:0.0:1787779581.876265:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787779581.876275:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e855b003c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622525004032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787779581.876337:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787779581.876407:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e855b003c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622525004032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779581.876414:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:0.0:1787779581.876486:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e855b02580 x1874622525004032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779597 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779581.876507:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855b02580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622525004032:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1787779582.433688:0:11360:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg109-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787779582.579693:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787779583.602950:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779583.656382:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779583.656440:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779583.656479:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779583.656559:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505042432 00000100:00100000:2.0:1787779583.656590:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505042432 00000100:00100000:2.0:1787779583.656677:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505042304 00000100:00100000:2.0:1787779583.656681:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505042304 00000100:00100000:2.0:1787779583.656707:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 104 00000100:00100000:2.0:1787779583.656758:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e88195c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54e1e60c-3037-4ae3-b045-838eb9e0ad0b+5:2360:x1874622505042432:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:2.0:1787779583.656862:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e88195c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54e1e60c-3037-4ae3-b045-838eb9e0ad0b+5:2360:x1874622505042432:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 106us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779583.656870:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 104 00000100:00100000:2.0:1787779583.656891:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 105 00000100:00100000:2.0:1787779583.656898:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e88195f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:2360:x1874622505042304:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:2.0:1787779583.656933:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e88195f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:2360:x1874622505042304:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 29us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779583.656963:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 105 00000100:00080000:1.0:1787779583.657344:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787779583.657433:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505042176 00000100:00100000:0.0:1787779583.657439:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505042176 00000100:00100000:0.0:1787779583.657479:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 251 00000100:00100000:0.0:1787779583.657487:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+13:2360:x1874622505042176:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:0.0:1787779583.657527:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+13:2360:x1874622505042176:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 42us (1161us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779583.657544:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 251 00010000:00010000:0.0:1787779584.632226:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787779585.459422:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855b02580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622525004160:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787779585.459610:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779585.459748:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525004160 00000100:00100000:2.0:1787779585.459758:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525004160 00000100:00100000:2.0:1787779585.459835:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787779585.459848:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e848f37840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622525004160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787779585.459897:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787779585.459949:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e848f37840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622525004160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779585.459956:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:1.0:1787779585.459971:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787779585.460001:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e855b02580 x1874622525004160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779601 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779585.460020:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855b02580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622525004160:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787779585.651599:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779586.485173:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e848f34780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c28aae66-2825-42c5-8f52-61f687e868c9:3304:1874622525004288:0@lo:400:kworker.0 00000100:00100000:2.0:1787779586.485185:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e848f361c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622525004672:0@lo:400:kworker.0 00000100:00100000:1.0:1787779586.485288:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e848f35680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874622525004416:0@lo:400:kworker.0 00000100:00100000:0.0:1787779586.490176:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e848f352c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874622525004544:0@lo:400:kworker.0 00000100:00100000:2.0:1787779586.494286:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779586.494395:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525004672 00000100:00100000:2.0:1787779586.494407:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525004672 00000100:00100000:2.0:1787779586.494470:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787779586.494483:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e855b3d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622525004672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779586.494561:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779586.494573:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e855b3d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622525004672:12345-0@lo:400:kworker.0 Request processed in 94us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779586.494581:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787779586.494605:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e848f343c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874622525004800:0@lo:400:kworker.0 00000100:00100000:2.0:1787779586.494610:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525004288 00000100:00100000:2.0:1787779586.494614:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525004288 00000100:00100000:3.0:1787779586.494648:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779586.494661:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1787779586.494667:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+19:3304:x1874622525004288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779586.494703:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+19:3304:x1874622525004288:12345-0@lo:400:kworker.0 Request processed in 35us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779586.494723:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1787779586.494769:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525004800 00000100:00100000:2.0:1787779586.494773:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525004800 00000100:00100000:2.0:1787779586.494887:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787779586.494966:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e851683c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874622525004800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779586.494999:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e851683c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874622525004800:12345-0@lo:400:kworker.0 Request processed in 36us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779586.495005:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:2.0:1787779586.495023:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787779586.495064:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e848f361c0 x1874622525004672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779602 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779586.495081:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e848f361c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622525004672:0@lo:400:kworker.0 00000100:00100000:1.0:1787779586.495512:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779586.495552:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e848f36940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874622525004928:0@lo:400:kworker.0 00000100:00100000:1.0:1787779586.495581:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779586.495727:0:10229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525004928 00000100:00100000:3.0:1787779586.495732:0:10229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525004928 00000100:00100000:3.0:1787779586.495771:0:10229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787779586.496207:0:10229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e88195fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874622525004928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779586.496265:0:10229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e88195fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874622525004928:12345-0@lo:400:kworker.0 Request processed in 401us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779586.496272:0:10229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787779586.496683:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525004416 00000100:00100000:1.0:1787779586.496688:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525004416 00000100:00100000:1.0:1787779586.496752:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787779586.496760:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e88195f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874622525004416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779586.496799:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e88195f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874622525004416:12345-0@lo:400:kworker.0 Request processed in 41us (1287us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779586.496820:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787779586.498925:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e848f35680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874622525004416:0@lo:400:kworker.0 00010000:00080000:3.0:1787779586.498952:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e848f36940 x1874622525004928/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779602 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779586.498963:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e848f36940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874622525004928:0@lo:400:kworker.0 00000100:00100000:3.0:1787779586.499017:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e848f343c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874622525004800:0@lo:400:kworker.0 00000100:00100000:3.0:1787779586.499029:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e848f34780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c28aae66-2825-42c5-8f52-61f687e868c9:3304:1874622525004288:0@lo:400:kworker.0 00000100:00080000:2.0:1787779586.499247:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787779586.510459:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779586.510637:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525004544 00000100:00100000:0.0:1787779586.510651:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525004544 00000100:00100000:0.0:1787779586.510774:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787779586.510800:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e88195e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874622525004544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779586.510882:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e88195e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874622525004544:12345-0@lo:400:kworker.0 Request processed in 86us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779586.511145:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787779586.511213:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e848f352c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874622525004544:0@lo:400:kworker.0 00000100:00080000:1.0:1787779586.511486:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787779586.677093:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787779586.998358:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787779586.998395:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e88195de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622525005056:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787779586.998517:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779587.004340:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525005056 00000100:00100000:1.0:1787779587.004365:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525005056 00000100:00100000:1.0:1787779587.004439:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787779587.004454:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e855b3cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622525005056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787779587.004514:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787779587.004662:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e855b3cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622525005056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 211us (6144us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779587.004670:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:2.0:1787779587.005244:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e88195de00 x1874622525005056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779602 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779587.005277:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e88195de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622525005056:0@lo:13:osp-pre-1-0.0 00000001:02000400:0.0:1787779587.557269:0:11460:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 17:26:24 (1787779584) === 00010000:00010000:3.0:1787779587.700708:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779588.095318:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779588.095382:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779588.095537:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505042560 00000100:00100000:2.0:1787779588.095549:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505042560 00000100:00100000:2.0:1787779588.095646:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 14 00000100:00100000:2.0:1787779588.095680:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e88195de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:2360:x1874622505042560:12345-192.168.201.9@tcp:41:mkdir.0 00000004:00000024:2.0:1787779588.095773:0:8197:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787779588.095898:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e88195de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:2360:x1874622505042560:12345-192.168.201.9@tcp:41:mkdir.0 Request processed in 221us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779588.095906:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 14 00000100:00100000:3.0:1787779588.096305:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505042688 00000100:00100000:3.0:1787779588.096311:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505042688 00000100:00100000:3.0:1787779588.096353:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 0 00000100:00100000:3.0:1787779588.096361:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e88195cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:9700:x1874622505042688:12345-192.168.201.9@tcp:700:mkdir.0 00000100:00100000:3.0:1787779588.096410:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e88195cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:9700:x1874622505042688:12345-192.168.201.9@tcp:700:mkdir.0 Request processed in 50us (1028us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779588.096426:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 0 00000100:00080000:1.0:1787779588.098611:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787779588.107514:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779588.108421:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505042944 00000100:00100000:3.0:1787779588.108436:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505042944 00000100:00100000:3.0:1787779588.108534:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 15 00000100:00100000:3.0:1787779588.108545:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e88195d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:9700:x1874622505042944:12345-192.168.201.9@tcp:36:mkdir.0 00010000:00010000:3.0:1787779588.108624:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787779588.115086:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4200/0x9e63ba8af6888f60 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedab68 expref: 6 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779588.115129:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e860c40800) 00010000:00010000:3.0:1787779588.115156:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787779588.116623:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5a00/0x9e63ba8af688907f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779588.116647:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5a00/0x9e63ba8af688907f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779588.116660:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5a00/0x9e63ba8af688907f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779588.116699:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af6889086 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779588.116707:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af6889086 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779588.116732:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af6889086 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787779588.125200:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:3.0:1787779588.125228:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5a00/0x9e63ba8af688907f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779588.125240:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5a00/0x9e63ba8af688907f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779588.125248:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5a00/0x9e63ba8af688907f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779588.125253:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e8429d5a00 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:3.0:1787779588.125258:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5a00/0x9e63ba8af688907f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779588.125266:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5a00/0x9e63ba8af688907f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779588.125284:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e87450a500) 00010000:00010000:3.0:1787779588.125288:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779588.125293:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5a00/0x9e63ba8af688907f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779588.125300:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5a00/0x9e63ba8af688907f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787779588.125324:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006a15844e reply state 00000000fe348d1e transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af6889086 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779588.125333:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787779588.126664:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e88195d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+7:9700:x1874622505042944:12345-192.168.201.9@tcp:36:mkdir.0 Request processed in 18114us (19178us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1787779588.126678:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 15 00010000:00010000:1.0:1787779588.156325:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af6889086 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.156341:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af6889086 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.156348:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af6889086 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.156355:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e8429d4000 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:1.0:1787779588.156360:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af6889086 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.156368:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af6889086 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.156398:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff98e87450ae00) 00010000:00010000:1.0:1787779588.156402:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787779588.156407:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af6889086 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.156414:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af6889086 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779588.164120:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779588.164195:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505043072 00000100:00100000:2.0:1787779588.164213:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505043072 00000100:00100000:2.0:1787779588.164325:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 16 00000100:00100000:2.0:1787779588.164340:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e88195c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:9701:x1874622505043072:12345-192.168.201.9@tcp:101:chmod.0 00010000:00010000:2.0:1787779588.164371:0:8197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779588.164418:0:8197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af688908d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedabed expref: -99 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779588.164533:0:8197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66a00/0x9e63ba8af6889094 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779588.164552:0:8197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66a00/0x9e63ba8af6889094 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779588.164568:0:8197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66a00/0x9e63ba8af6889094 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787779588.164650:0:8197:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787779588.164655:0:8197:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787779588.164705:0:8197:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66a00/0x9e63ba8af6889094 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779588.164776:0:8197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af688908d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedabed expref: 8 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779588.164822:0:8197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66a00/0x9e63ba8af6889094 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedabed expref: 7 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779588.164832:0:8197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e84927f800) 00010000:00010000:2.0:1787779588.164835:0:8197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787779588.164840:0:8197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87aa66a00, rc 0) 00000100:00100000:2.0:1787779588.164923:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e88195c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+7:9701:x1874622505043072:12345-192.168.201.9@tcp:101:chmod.0 Request processed in 588us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779588.164931:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 16 00000100:00100000:0.0:1787779588.174346:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779588.174515:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505043328 00000100:00100000:1.0:1787779588.174529:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505043328 00000100:00100000:1.0:1787779588.174611:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 17 00000100:00100000:1.0:1787779588.174623:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e855b03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+7:9701:x1874622505043328:12345-192.168.201.9@tcp:36:chmod.0 00010000:00010000:1.0:1787779588.174702:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787779588.174772:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66a00/0x9e63ba8af6889094 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedabed expref: 7 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.175103:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e84927f800) 00010000:00010000:1.0:1787779588.175201:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787779588.175241:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af688909b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.175329:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af688909b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.175343:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af688909b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787779588.176189:0:5836:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000063569ff0 reply state 000000008a5fde69 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af688909b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779588.176211:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787779588.176232:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1787779588.176442:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e855b03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+8:9701:x1874622505043328:12345-192.168.201.9@tcp:36:chmod.0 Request processed in 1816us (2107us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1787779588.176452:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 17 00010000:00010000:0.0:1787779588.178805:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af688909b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779588.178824:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af688909b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779588.178831:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af688909b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779588.178837:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87a98a400 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:0.0:1787779588.178842:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af688909b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779588.178849:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af688909b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779588.178888:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e860c40a00) 00010000:00010000:0.0:1787779588.178891:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787779588.178897:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af688909b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779588.178903:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af688909b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779588.230393:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779588.230611:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505043456 00000100:00100000:2.0:1787779588.230622:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505043456 00000100:00100000:2.0:1787779588.230692:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 18 00000100:00100000:2.0:1787779588.230702:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e855b02580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+7:9702:x1874622505043456:12345-192.168.201.9@tcp:101:chown.0 00010000:00010000:2.0:1787779588.230754:0:8197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779588.230796:0:8197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af68890a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedabf4 expref: -99 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779588.230870:0:8197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67400/0x9e63ba8af68890a9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779588.230895:0:8197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67400/0x9e63ba8af68890a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779588.230909:0:8197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67400/0x9e63ba8af68890a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787779588.230971:0:8197:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787779588.230987:0:8197:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787779588.231358:0:8197:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67400/0x9e63ba8af68890a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779588.231388:0:8197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af68890a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedabf4 expref: 9 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779588.231409:0:8197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67400/0x9e63ba8af68890a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedabf4 expref: 8 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779588.231417:0:8197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e84927f700) 00010000:00010000:2.0:1787779588.231421:0:8197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787779588.231425:0:8197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87aa67400, rc 0) 00000100:00100000:2.0:1787779588.231519:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e855b02580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+8:9702:x1874622505043456:12345-192.168.201.9@tcp:101:chown.0 Request processed in 817us (1134us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779588.231527:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 18 00000100:00100000:3.0:1787779588.235599:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779588.235915:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505043584 00000100:00100000:0.0:1787779588.235927:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505043584 00000100:00100000:0.0:1787779588.235996:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 19 00000100:00100000:0.0:1787779588.236005:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e851680b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+8:9702:x1874622505043584:12345-192.168.201.9@tcp:101:chown.0 00010000:00010000:0.0:1787779588.236028:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787779588.236059:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af68890b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedabfb expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779588.236155:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af68890b7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779588.236173:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af68890b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779588.236185:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af68890b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779588.236206:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af68890be lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779588.236214:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af68890be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779588.236231:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af68890be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779588.236365:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af68890c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779588.236373:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af68890c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779588.236379:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af68890c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787779588.236420:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:0.0:1787779588.236424:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787779588.236466:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af68890c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779588.236480:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af68890b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779588.236487:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af68890b7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779588.236493:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af68890b7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779588.236508:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e848f69200 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:0.0:1787779588.236513:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af68890b7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779588.236521:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af68890b7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779588.236540:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e84927f700) 00010000:00010000:0.0:1787779588.236543:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787779588.236549:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af68890b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779588.236556:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af68890b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779588.236571:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af68890be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779588.236577:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af68890be lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779588.236582:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af68890be lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779588.236587:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e848f68000 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:0.0:1787779588.236590:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af68890be lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779588.236596:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af68890be lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779588.236603:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff98e860e78800) 00010000:00010000:0.0:1787779588.236606:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787779588.236609:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af68890be lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779588.236614:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af68890be lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779588.236664:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af68890b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedabfb expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779588.236678:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af68890c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedabfb expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779588.236685:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98e860e78a00) 00010000:00010000:0.0:1787779588.236687:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787779588.236690:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e848f68200, rc 0) 00000100:00100000:0.0:1787779588.237296:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e851680b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+9:9702:x1874622505043584:12345-192.168.201.9@tcp:101:chown.0 Request processed in 1287us (1704us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779588.237316:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 19 00000100:00100000:1.0:1787779588.258830:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779588.259003:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505043840 00000100:00100000:2.0:1787779588.259013:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505043840 00000100:00100000:2.0:1787779588.259077:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 20 00000100:00100000:2.0:1787779588.259087:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ab37c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+9:9702:x1874622505043840:12345-192.168.201.9@tcp:36:chown.0 00010000:00010000:2.0:1787779588.259149:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787779588.259175:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af68890c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedabfb expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779588.259192:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98e860e78a00) 00010000:00010000:2.0:1787779588.259203:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787779588.259227:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af68890cc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779588.259252:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af68890cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779588.259264:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af68890cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787779588.413740:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000001:00080000:0.0:1787779588.414211:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:1.0:1787779588.414271:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000049fa7b7b reply state 0000000084b78f71 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af68890cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779588.414285:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787779588.414439:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:1.0:1787779588.414684:0:5837:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1787779588.414706:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ab37c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+7:9702:x1874622505043840:12345-192.168.201.9@tcp:36:chown.0 Request processed in 155617us (155882us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1787779588.414739:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 20 00010000:00010000:0.0:1787779588.414978:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af68890cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779588.414988:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af68890cc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779588.414996:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af68890cc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779588.415002:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87aa67e00 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:0.0:1787779588.415006:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af68890cc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779588.415014:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af68890cc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779588.415039:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98e84927f900) 00010000:00010000:0.0:1787779588.415042:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787779588.415047:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af68890cc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779588.415054:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af68890cc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779588.459276:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779588.459461:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505043968 00000100:00100000:0.0:1787779588.459470:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505043968 00000100:00100000:0.0:1787779588.459544:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 21 00000100:00100000:0.0:1787779588.459554:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ab34b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:9703:x1874622505043968:12345-192.168.201.9@tcp:101:touch.500 00010000:00010000:0.0:1787779588.459591:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787779588.459613:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af68890d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedac02 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787779588.464664:0:5836:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 4994us 00010000:00010000:1.0:1787779588.494648:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ac00/0x9e63ba8af68890da lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.494672:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ac00/0x9e63ba8af68890da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.494683:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ac00/0x9e63ba8af68890da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.494699:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98bc00/0x9e63ba8af68890e1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.494707:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98bc00/0x9e63ba8af68890e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.494749:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98bc00/0x9e63ba8af68890e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.496318:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a200/0x9e63ba8af68890e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.496332:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a200/0x9e63ba8af68890e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.496342:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a200/0x9e63ba8af68890e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787779588.496433:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787779588.496437:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787779588.498073:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a200/0x9e63ba8af68890e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.498095:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ac00/0x9e63ba8af68890da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.498103:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ac00/0x9e63ba8af68890da lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.498111:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ac00/0x9e63ba8af68890da lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.498766:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87a98ac00 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:1.0:1787779588.498771:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ac00/0x9e63ba8af68890da lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.498779:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ac00/0x9e63ba8af68890da lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.498985:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e84927f700) 00010000:00010000:1.0:1787779588.498988:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787779588.498993:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ac00/0x9e63ba8af68890da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.498998:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ac00/0x9e63ba8af68890da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.499010:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98bc00/0x9e63ba8af68890e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.499015:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98bc00/0x9e63ba8af68890e1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.499020:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98bc00/0x9e63ba8af68890e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.499025:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87a98bc00 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:1.0:1787779588.499027:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98bc00/0x9e63ba8af68890e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.499032:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98bc00/0x9e63ba8af68890e1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.499038:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff98e860c40e00) 00010000:00010000:1.0:1787779588.499040:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787779588.499042:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98bc00/0x9e63ba8af68890e1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.499048:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98bc00/0x9e63ba8af68890e1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.499107:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af68890d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac02 expref: 8 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.499688:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a200/0x9e63ba8af68890e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac02 expref: 7 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.499697:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98e860c40300) 00010000:00010000:1.0:1787779588.499699:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787779588.499702:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87a98a200, rc 0) 00000100:00100000:1.0:1787779588.500018:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ab34b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+7:9703:x1874622505043968:12345-192.168.201.9@tcp:101:touch.500 Request processed in 40464us (40765us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779588.500027:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 21 00000100:00100000:2.0:1787779588.513312:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779588.513381:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505044224 00000100:00100000:1.0:1787779588.513391:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505044224 00000100:00100000:1.0:1787779588.513459:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 22 00000100:00100000:1.0:1787779588.513469:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e855b3e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+7:9703:x1874622505044224:12345-192.168.201.9@tcp:101:touch.500 00010000:00010000:1.0:1787779588.513489:0:8197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779588.513517:0:8197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af68890ef lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedac09 expref: -99 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.513853:0:8197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a000/0x9e63ba8af68890f6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.513868:0:8197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a000/0x9e63ba8af68890f6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.513891:0:8197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a000/0x9e63ba8af68890f6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.513914:0:8197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af68890fd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.513922:0:8197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af68890fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.513929:0:8197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af68890fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787779588.514777:0:8197:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:1.0:1787779588.515035:0:8197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b800/0x9e63ba8af6889104 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.515047:0:8197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b800/0x9e63ba8af6889104 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.515056:0:8197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b800/0x9e63ba8af6889104 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.515090:0:8197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a000/0x9e63ba8af68890f6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.515098:0:8197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a000/0x9e63ba8af68890f6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.515105:0:8197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a000/0x9e63ba8af68890f6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.515110:0:8197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87a98a000 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:1.0:1787779588.515114:0:8197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a000/0x9e63ba8af68890f6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.515133:0:8197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a000/0x9e63ba8af68890f6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.515146:0:8197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98e860c40300) 00010000:00010000:1.0:1787779588.515149:0:8197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787779588.515155:0:8197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a000/0x9e63ba8af68890f6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.515161:0:8197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a000/0x9e63ba8af68890f6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787779588.515175:0:8197:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009f527c2b reply state 00000000f3bc6990 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af68890fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779588.515183:0:8197:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787779588.515216:0:8197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af68890ef lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac09 expref: 10 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.515230:0:8197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b800/0x9e63ba8af6889104 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac09 expref: 9 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.515238:0:8197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff98e860c40000) 00010000:00010000:1.0:1787779588.515240:0:8197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787779588.515242:0:8197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87a98b800, rc 0) 00000100:00100000:1.0:1787779588.515317:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e855b3e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+10:9703:x1874622505044224:12345-192.168.201.9@tcp:101:touch.500 Request processed in 1849us (2014us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1787779588.515326:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 22 00000100:00100000:2.0:1787779588.525934:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00010000:00010000:0.0:1787779588.526485:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af68890fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779588.526507:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af68890fd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779588.526515:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af68890fd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779588.526521:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87a98a400 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:0.0:1787779588.526527:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af68890fd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779588.526549:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af68890fd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779588.526568:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x4a848b87 (ffff98e860c40500) 00010000:00010000:0.0:1787779588.526571:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787779588.526577:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af68890fd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779588.526583:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af68890fd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779588.526664:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505044480 00000100:00100000:1.0:1787779588.526674:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505044480 00000100:00100000:1.0:1787779588.526768:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 23 00000100:00100000:1.0:1787779588.526778:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e855b3f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+9:9703:x1874622505044480:12345-192.168.201.9@tcp:36:touch.500 00010000:00010000:1.0:1787779588.526840:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787779588.526856:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b800/0x9e63ba8af6889104 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac09 expref: 9 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.526866:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff98e860c40000) 00010000:00010000:1.0:1787779588.526882:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787779588.526919:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af6889112 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.526931:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af6889112 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.526940:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af6889112 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787779588.527063:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006d618af3 reply state 000000009ed1c124 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af6889112 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779588.527071:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787779588.527167:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e855b3f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+10:9703:x1874622505044480:12345-192.168.201.9@tcp:36:touch.500 Request processed in 390us (1240us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1787779588.527175:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 23 00010000:00010000:3.0:1787779588.530217:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af6889112 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779588.530233:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af6889112 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779588.530240:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af6889112 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779588.530246:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87a98a600 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:3.0:1787779588.530250:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af6889112 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779588.530258:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af6889112 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779588.530274:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff98e860c40e00) 00010000:00010000:3.0:1787779588.530276:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779588.530282:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af6889112 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779588.530287:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af6889112 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779588.531798:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779588.532007:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505044608 00000100:00100000:1.0:1787779588.532016:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505044608 00000100:00100000:1.0:1787779588.532070:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 24 00000100:00100000:1.0:1787779588.532080:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e848f34f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+9:9703:x1874622505044608:12345-192.168.201.9@tcp:101:touch.500 00010000:00010000:1.0:1787779588.532103:0:8197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779588.532149:0:8197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a000/0x9e63ba8af6889119 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedac10 expref: -99 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.532221:0:8197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a000/0x9e63ba8af6889119 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac10 expref: 10 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.532236:0:8197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a000/0x9e63ba8af6889119 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac10 expref: 10 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.532257:0:8197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff98e860c40400) 00010000:00010000:1.0:1787779588.532260:0:8197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787779588.532264:0:8197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87a98a000, rc 0) 00000100:00100000:1.0:1787779588.532321:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e848f34f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+10:9703:x1874622505044608:12345-192.168.201.9@tcp:101:touch.500 Request processed in 243us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779588.532328:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 24 00000100:00100000:0.0:1787779588.543282:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779588.544894:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505044736 00000100:00100000:2.0:1787779588.544908:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505044736 00000100:00100000:2.0:1787779588.544964:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 16 00000100:00100000:2.0:1787779588.544972:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e855a63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2356:x1874622505044736:12345-192.168.201.9@tcp:8:touch.500 00010000:00080000:2.0:1787779588.545003:0:6680:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from e225400f-8d32-48a8-ab5e-fe4d3780a20c@192.168.201.9@tcp t0 exp 0000000000000000 cur 354 last 0 00000020:00000080:2.0:1787779588.545035:0:6680:0:(genops.c:1385:class_connect()) connect: client e225400f-8d32-48a8-ab5e-fe4d3780a20c, cookie 0x9e63ba8af6889120 00002000:00100000:2.0:1787779588.545047:0:6680:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e225400f-8d32-48a8-ab5e-fe4d3780a20c/ffff98e846b17800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113939 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787779588.545067:0:6680:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787779588.545384:0:6680:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787779588.545912:0:6680:0:(import.c:65:import_set_state_nolock()) ffff98e87a569800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787779588.545981:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e855a63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:2356:x1874622505044736:12345-192.168.201.9@tcp:8:touch.500 Request processed in 1008us (2710us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779588.545990:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 16 00000100:00100000:3.0:1787779588.553590:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779588.553788:0:10229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505044864 00000100:00100000:0.0:1787779588.553799:0:10229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505044864 00000100:00100000:0.0:1787779588.553873:0:10229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 17 00000100:00100000:0.0:1787779588.553884:0:10229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e851683480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:0:x1874622505044864:12345-192.168.201.9@tcp:2:touch.500 00000100:00080000:1.0:1787779588.554708:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787779588.645841:0:10229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e851683480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+7:0:x1874622505044864:12345-192.168.201.9@tcp:2:touch.500 Request processed in 91949us (92252us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1787779588.645855:0:10229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 17 00000001:00080000:0.0:1787779588.646453:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:0.0:1787779588.646557:0:6704:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e225400f-8d32-48a8-ab5e-fe4d3780a20c 00000100:00100000:1.0:1787779588.649187:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779588.649268:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505045120 00000100:00100000:3.0:1787779588.649277:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505045120 00000100:00100000:3.0:1787779588.649329:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 2 00000100:00100000:3.0:1787779588.649338:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ab37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+10:9703:x1874622505045120:12345-192.168.201.9@tcp:35:touch.500 00000100:00100000:3.0:1787779588.649684:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ab37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+11:9703:x1874622505045120:12345-192.168.201.9@tcp:35:touch.500 Request processed in 346us (505us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1787779588.649708:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 2 00000100:00100000:2.0:1787779588.692499:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779588.692909:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505045248 00000100:00100000:1.0:1787779588.692920:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505045248 00000100:00100000:1.0:1787779588.692982:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 25 00000100:00100000:1.0:1787779588.692992:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e848f352c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+11:9704:x1874622505045248:12345-192.168.201.9@tcp:101:rm.0 00010000:00010000:1.0:1787779588.693018:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779588.693038:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98bc00/0x9e63ba8af6889127 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedac17 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.693135:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ac00/0x9e63ba8af688912e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.693150:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ac00/0x9e63ba8af688912e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.693162:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ac00/0x9e63ba8af688912e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787779588.693230:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787779588.693234:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787779588.693271:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ac00/0x9e63ba8af688912e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.693544:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98bc00/0x9e63ba8af6889127 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac17 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.693564:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ac00/0x9e63ba8af688912e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac17 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.693572:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98e860c40300) 00010000:00010000:1.0:1787779588.693575:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787779588.693579:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87a98ac00, rc 0) 00000100:00100000:1.0:1787779588.693649:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e848f352c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+12:9704:x1874622505045248:12345-192.168.201.9@tcp:101:rm.0 Request processed in 658us (1167us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779588.693656:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 25 00000100:00100000:0.0:1787779588.711091:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779588.712019:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505045504 00000100:00100000:1.0:1787779588.712029:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505045504 00000100:00100000:1.0:1787779588.712104:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 26 00000100:00100000:1.0:1787779588.712114:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e855a62d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+12:9704:x1874622505045504:12345-192.168.201.9@tcp:101:rm.0 00010000:00010000:1.0:1787779588.712136:0:8197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779588.712155:0:8197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98bc00/0x9e63ba8af6889135 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedac1e expref: -99 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787779588.712265:0:8197:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1787779588.712417:0:8197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98bc00/0x9e63ba8af6889135 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac1e expref: 14 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.712431:0:8197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e84927f700) 00010000:00010000:1.0:1787779588.712433:0:8197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787779588.712438:0:8197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98bc00/0x9e63ba8af6889135 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac1e expref: 14 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.712452:0:8197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87a98bc00, rc 0) 00000100:00100000:1.0:1787779588.712520:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e855a62d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+13:9704:x1874622505045504:12345-192.168.201.9@tcp:101:rm.0 Request processed in 407us (1436us total) trans 4294967303 rc 301/301 00000100:00100000:1.0:1787779588.712528:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 26 00000100:00100000:2.0:1787779588.720970:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779588.721572:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505045632 00000100:00100000:3.0:1787779588.721583:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505045632 00000100:00100000:3.0:1787779588.721681:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 3 00000100:00100000:3.0:1787779588.721692:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e848f34780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+13:9704:x1874622505045632:12345-192.168.201.9@tcp:37:rm.0 00010000:00010000:1.0:1787779588.724702:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779588.735447:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e848f34780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+13:9704:x1874622505045632:12345-192.168.201.9@tcp:37:rm.0 Request processed in 13738us (14468us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779588.739685:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779588.739900:0:5839:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:2.0:1787779588.739909:0:5839:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000100:00100000:1.0:1787779588.740422:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505045888 00000100:00100000:1.0:1787779588.740431:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505045888 00000100:00100000:2.0:1787779588.740756:0:11475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 4 00000100:00100000:2.0:1787779588.740768:0:11475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e86c75e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+14:9704:x1874622505045888:12345-192.168.201.9@tcp:35:rm.0 00000100:00100000:2.0:1787779588.741032:0:11475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e86c75e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+15:9704:x1874622505045888:12345-192.168.201.9@tcp:35:rm.0 Request processed in 266us (1354us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1787779588.741138:0:11475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 4 00000100:00100000:0.0:1787779588.743090:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 3 00000100:00100000:2.0:1787779588.753556:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779588.753743:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505046144 00000100:00100000:1.0:1787779588.753753:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505046144 00000100:00100000:1.0:1787779588.753807:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 27 00000100:00100000:1.0:1787779588.753817:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e848f343c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+14:9704:x1874622505046144:12345-192.168.201.9@tcp:101:rm.0 00010000:00010000:1.0:1787779588.753841:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779588.753862:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98bc00/0x9e63ba8af6889143 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedac25 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.754012:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af688914a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.754027:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af688914a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.754052:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af688914a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787779588.754064:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1787779588.754532:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98bc00/0x9e63ba8af6889143 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac25 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.754551:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af688914a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac25 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.754559:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98e860c40300) 00010000:00010000:1.0:1787779588.754562:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787779588.754565:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87a98b600, rc 0) 00000100:00100000:1.0:1787779588.755361:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e848f343c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+16:9704:x1874622505046144:12345-192.168.201.9@tcp:101:rm.0 Request processed in 1542us (1810us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1787779588.755371:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 27 00000100:00100000:0.0:1787779588.776901:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779588.776938:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779588.776988:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779588.777227:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505046272 00000100:00100000:1.0:1787779588.777237:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505046272 00000100:00100000:1.0:1787779588.777289:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505046528 00000100:00100000:1.0:1787779588.777301:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505046528 00000100:00100000:1.0:1787779588.777339:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 109 00000100:00100000:1.0:1787779588.777348:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e855a63840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54e1e60c-3037-4ae3-b045-838eb9e0ad0b+5:2360:x1874622505046528:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:1.0:1787779588.777432:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e855a63840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54e1e60c-3037-4ae3-b045-838eb9e0ad0b+5:2360:x1874622505046528:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 86us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779588.777456:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 109 00000100:00100000:1.0:1787779588.777474:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 28 00000100:00100000:1.0:1787779588.777479:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e855a62580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+16:9704:x1874622505046272:12345-192.168.201.9@tcp:41:rm.0 00000004:00000024:1.0:1787779588.777531:0:8197:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:1.0:1787779588.777560:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e855a62580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+16:9704:x1874622505046272:12345-192.168.201.9@tcp:41:rm.0 Request processed in 80us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779588.777565:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 28 00000100:00080000:1.0:1787779588.777582:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787779588.778674:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505046400 00000100:00100000:3.0:1787779588.778682:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505046400 00000100:00100000:3.0:1787779588.778761:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 253 00000100:00100000:3.0:1787779588.778769:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+13:2360:x1874622505046400:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:3.0:1787779588.778816:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+13:2360:x1874622505046400:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 48us (1828us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779588.778823:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 253 00000100:00100000:0.0:1787779588.796045:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779588.797476:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505046656 00000100:00100000:1.0:1787779588.797489:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505046656 00000100:00100000:1.0:1787779588.797571:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 29 00000100:00100000:1.0:1787779588.797582:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87fd29e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+16:9704:x1874622505046656:12345-192.168.201.9@tcp:101:rm.0 00010000:00010000:1.0:1787779588.797602:0:8197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779588.797624:0:8197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98be00/0x9e63ba8af6889158 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedac2c expref: -99 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.797692:0:8197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af688915f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.797708:0:8197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af688915f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.797761:0:8197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af688915f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.797778:0:8197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98bc00/0x9e63ba8af6889166 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.797804:0:8197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98bc00/0x9e63ba8af6889166 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.797812:0:8197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98bc00/0x9e63ba8af6889166 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.797930:0:8197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b800/0x9e63ba8af688916d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.797939:0:8197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b800/0x9e63ba8af688916d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.797947:0:8197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b800/0x9e63ba8af688916d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787779588.797976:0:8197:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:1.0:1787779588.797980:0:8197:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787779588.797999:0:8197:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b800/0x9e63ba8af688916d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.798010:0:8197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b800/0x9e63ba8af688916d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.798019:0:8197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af688915f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.798024:0:8197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af688915f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.798030:0:8197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af688915f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.798058:0:8197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87a98aa00 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:1.0:1787779588.798063:0:8197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af688915f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.798070:0:8197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af688915f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.798082:0:8197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98e860c40300) 00010000:00010000:1.0:1787779588.798085:0:8197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787779588.798089:0:8197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af688915f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.798096:0:8197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af688915f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.798110:0:8197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98bc00/0x9e63ba8af6889166 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.798116:0:8197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98bc00/0x9e63ba8af6889166 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.798122:0:8197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98bc00/0x9e63ba8af6889166 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.798126:0:8197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87a98bc00 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:1.0:1787779588.798129:0:8197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98bc00/0x9e63ba8af6889166 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.798134:0:8197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98bc00/0x9e63ba8af6889166 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.798152:0:8197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x4a848b87 (ffff98e860c40000) 00010000:00010000:1.0:1787779588.798154:0:8197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787779588.798158:0:8197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98bc00/0x9e63ba8af6889166 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.798164:0:8197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98bc00/0x9e63ba8af6889166 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.798196:0:8197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98be00/0x9e63ba8af6889158 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac2c expref: 18 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.798208:0:8197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b800/0x9e63ba8af688916d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac2c expref: 17 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.798215:0:8197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff98e860c40400) 00010000:00010000:1.0:1787779588.798217:0:8197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787779588.798220:0:8197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87a98b800, rc 0) 00000100:00100000:1.0:1787779588.798291:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87fd29e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+17:9704:x1874622505046656:12345-192.168.201.9@tcp:101:rm.0 Request processed in 711us (2256us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779588.798646:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 29 00000100:00100000:1.0:1787779588.801655:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779588.801753:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505046912 00000100:00100000:2.0:1787779588.801764:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505046912 00000100:00100000:2.0:1787779588.801823:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 30 00000100:00100000:2.0:1787779588.801834:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ab35a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+17:9704:x1874622505046912:12345-192.168.201.9@tcp:36:rm.0 00010000:00010000:2.0:1787779588.801901:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787779588.801927:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b800/0x9e63ba8af688916d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac2c expref: 17 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779588.801947:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a000/0x9e63ba8af6889119 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac10 expref: 16 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779588.801959:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff98e860c40400) 00010000:00010000:2.0:1787779588.801973:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ac00/0x9e63ba8af688912e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac17 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779588.801982:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98e860c40300) 00010000:00010000:2.0:1787779588.801985:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787779588.802004:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66c00/0x9e63ba8af6889174 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779588.802017:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66c00/0x9e63ba8af6889174 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779588.802039:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66c00/0x9e63ba8af6889174 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779588.802054:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67c00/0x9e63ba8af688917b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779588.802062:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67c00/0x9e63ba8af688917b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779588.802068:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67c00/0x9e63ba8af688917b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779588.802220:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66800/0x9e63ba8af6889182 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779588.802230:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66800/0x9e63ba8af6889182 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779588.802237:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66800/0x9e63ba8af6889182 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787779588.802974:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1787779588.802985:0:5837:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 354544272622ns, next at 355544270492ns, rc = 0 00010000:00010000:2.0:1787779588.803040:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66600/0x9e63ba8af6889189 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779588.803050:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66600/0x9e63ba8af6889189 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779588.803058:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66600/0x9e63ba8af6889189 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779588.803075:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66600/0x9e63ba8af6889189 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779588.803082:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66600/0x9e63ba8af6889189 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779588.803088:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66600/0x9e63ba8af6889189 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779588.803113:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787779588.803131:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66800/0x9e63ba8af6889182 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779588.803136:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66800/0x9e63ba8af6889182 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779588.803142:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66800/0x9e63ba8af6889182 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779588.803147:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87aa66800 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:2.0:1787779588.803150:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66800/0x9e63ba8af6889182 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779588.803156:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66800/0x9e63ba8af6889182 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779588.803165:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff98e84927fe00) 00010000:00010000:2.0:1787779588.803167:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787779588.803170:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66800/0x9e63ba8af6889182 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779588.803184:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66800/0x9e63ba8af6889182 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779588.803198:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66c00/0x9e63ba8af6889174 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779588.803203:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66c00/0x9e63ba8af6889174 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779588.803208:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66c00/0x9e63ba8af6889174 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779588.803212:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87aa66c00 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:2.0:1787779588.803214:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66c00/0x9e63ba8af6889174 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779588.803219:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66c00/0x9e63ba8af6889174 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779588.803225:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98e860c40300) 00010000:00010000:2.0:1787779588.803227:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787779588.803230:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66c00/0x9e63ba8af6889174 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779588.803234:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66c00/0x9e63ba8af6889174 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787779588.803241:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009d3038b6 reply state 0000000006075719 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67c00/0x9e63ba8af688917b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779588.803248:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787779588.803330:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ab35a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+16:9704:x1874622505046912:12345-192.168.201.9@tcp:36:rm.0 Request processed in 1496us (1682us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1787779588.803338:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 30 00010000:00010000:3.0:1787779588.803595:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787779588.803602:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66600/0x9e63ba8af6889189 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779588.803608:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87aa66600 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:3.0:1787779588.803611:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66600/0x9e63ba8af6889189 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779588.803617:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66600/0x9e63ba8af6889189 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779588.803625:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff98e84927fe00) 00010000:00010000:3.0:1787779588.803627:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787779588.803630:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66600/0x9e63ba8af6889189 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779588.803641:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66600/0x9e63ba8af6889189 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779588.803661:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787779588.803663:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787779588.803664:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779588.805549:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67c00/0x9e63ba8af688917b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779588.805573:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67c00/0x9e63ba8af688917b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779588.805580:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67c00/0x9e63ba8af688917b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779588.805585:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87aa67c00 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:0.0:1787779588.805589:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67c00/0x9e63ba8af688917b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779588.805597:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67c00/0x9e63ba8af688917b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779588.805609:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x4a848b87 (ffff98e84927fb00) 00010000:00010000:0.0:1787779588.805612:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787779588.805616:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67c00/0x9e63ba8af688917b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779588.805622:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67c00/0x9e63ba8af688917b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779588.813864:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779588.814393:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505047168 00000100:00100000:2.0:1787779588.814404:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505047168 00000100:00100000:2.0:1787779588.814469:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 5 00000100:00100000:2.0:1787779588.814480:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ab361c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+15:9704:x1874622505047168:12345-192.168.201.9@tcp:35:rm.0 00000100:00100000:2.0:1787779588.814761:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ab361c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+16:9704:x1874622505047168:12345-192.168.201.9@tcp:35:rm.0 Request processed in 282us (906us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1787779588.814768:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 5 00000100:00100000:3.0:1787779588.817017:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779588.817154:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505047424 00000100:00100000:1.0:1787779588.817164:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505047424 00000100:00100000:1.0:1787779588.817223:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 31 00000100:00100000:1.0:1787779588.817232:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e851681a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+16:9704:x1874622505047424:12345-192.168.201.9@tcp:36:rm.0 00010000:00010000:1.0:1787779588.817284:0:8197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787779588.817451:0:8197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af688914a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac25 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.817474:0:8197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a200/0x9e63ba8af68890e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac02 expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.817486:0:8197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98e860c40300) 00010000:00010000:1.0:1787779588.817517:0:8197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67400/0x9e63ba8af68890a9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedabf4 expref: 14 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.817527:0:8197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e84927f700) 00010000:00010000:1.0:1787779588.817540:0:8197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787779588.817562:0:8197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98be00/0x9e63ba8af6889190 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.817575:0:8197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98be00/0x9e63ba8af6889190 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.817585:0:8197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98be00/0x9e63ba8af6889190 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.817597:0:8197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98bc00/0x9e63ba8af6889197 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.817605:0:8197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98bc00/0x9e63ba8af6889197 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.817611:0:8197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98bc00/0x9e63ba8af6889197 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.822913:0:8197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af688919e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.822938:0:8197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af688919e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.822951:0:8197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af688919e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787779588.823550:0:8197:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1787779588.823567:0:8197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af688919e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.823575:0:8197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af688919e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.823582:0:8197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af688919e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.823588:0:8197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87a98aa00 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:1.0:1787779588.823592:0:8197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af688919e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.823600:0:8197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af688919e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.823611:0:8197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98e860c40400) 00010000:00010000:1.0:1787779588.823614:0:8197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787779588.823618:0:8197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af688919e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.823625:0:8197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af688919e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.823649:0:8197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98be00/0x9e63ba8af6889190 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.823661:0:8197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98be00/0x9e63ba8af6889190 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.823666:0:8197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98be00/0x9e63ba8af6889190 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.823671:0:8197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87a98be00 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:1.0:1787779588.823674:0:8197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98be00/0x9e63ba8af6889190 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.823679:0:8197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98be00/0x9e63ba8af6889190 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.823687:0:8197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e860c40000) 00010000:00010000:1.0:1787779588.823690:0:8197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787779588.823693:0:8197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98be00/0x9e63ba8af6889190 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779588.823698:0:8197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98be00/0x9e63ba8af6889190 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787779588.823735:0:8197:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d6f97f8a reply state 0000000030f4b54e transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98bc00/0x9e63ba8af6889197 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779588.823745:0:8197:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787779588.823850:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e851681a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+15:9704:x1874622505047424:12345-192.168.201.9@tcp:36:rm.0 Request processed in 6615us (6836us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1787779588.823860:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 31 00010000:00010000:3.0:1787779588.844574:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98bc00/0x9e63ba8af6889197 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779588.844592:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98bc00/0x9e63ba8af6889197 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779588.844599:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98bc00/0x9e63ba8af6889197 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779588.844606:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87a98bc00 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:3.0:1787779588.844610:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98bc00/0x9e63ba8af6889197 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779588.844617:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98bc00/0x9e63ba8af6889197 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779588.844634:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff98e860c40700) 00010000:00010000:3.0:1787779588.844638:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779588.844642:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98bc00/0x9e63ba8af6889197 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779588.844648:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98bc00/0x9e63ba8af6889197 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779589.748707:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779590.579095:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e848f36940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622525005184:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787779590.579181:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1787779590.579302:0:6855:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 356320588857ns, next at 357320586775ns, rc = 0 00000100:00100000:1.0:1787779590.582375:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525005184 00000100:00100000:1.0:1787779590.582390:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525005184 00000100:00100000:1.0:1787779590.582661:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787779590.582672:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ab34f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622525005184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787779590.582737:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787779590.582828:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ab34f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622525005184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 159us (3646us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779590.582836:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:1.0:1787779590.582884:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e848f36940 x1874622525005184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779606 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779590.582905:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e848f36940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622525005184:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787779590.583141:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787779590.782895:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779591.603963:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e851680f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874622525005568:0@lo:400:kworker.0 00000100:00100000:3.0:1787779591.604040:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779591.604106:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787779591.604113:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e851681680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622525005696:0@lo:400:kworker.0 00000100:00100000:3.0:1787779591.604141:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779591.604175:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525005696 00000100:00100000:3.0:1787779591.604181:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525005696 00000100:00100000:3.0:1787779591.604224:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787779591.604232:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e8516830c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622525005696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779591.604281:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e8516830c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622525005696:12345-0@lo:400:kworker.0 Request processed in 49us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779591.604288:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:3.0:1787779591.604329:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e851681680 x1874622525005696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779607 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779591.604343:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e851681680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622525005696:0@lo:400:kworker.0 00000100:00100000:2.0:1787779591.604610:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e8516803c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874622525005440:0@lo:400:kworker.0 00000100:00100000:2.0:1787779591.604642:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779591.604670:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e851682940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874622525005952:0@lo:400:kworker.0 00000100:00100000:2.0:1787779591.604691:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779591.604731:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787779591.604737:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e8516821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c28aae66-2825-42c5-8f52-61f687e868c9:3305:1874622525005312:0@lo:400:kworker.0 00000100:00100000:2.0:1787779591.604765:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779591.604803:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e8516812c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874622525005824:0@lo:400:kworker.0 00000100:00100000:2.0:1787779591.604827:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779591.604854:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525005568 00000100:00100000:2.0:1787779591.604858:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525005568 00000100:00100000:2.0:1787779591.604896:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525005440 00000100:00100000:2.0:1787779591.604900:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525005440 00000100:00100000:2.0:1787779591.604912:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525005824 00000100:00100000:2.0:1787779591.604914:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525005824 00000100:00100000:2.0:1787779591.604943:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787779591.604950:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e851683840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874622525005568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779591.604988:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e851683840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874622525005568:12345-0@lo:400:kworker.0 Request processed in 38us (949us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779591.604994:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787779591.605007:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787779591.605012:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e848f35680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874622525005440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779591.605042:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e848f35680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874622525005440:12345-0@lo:400:kworker.0 Request processed in 29us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779591.605048:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787779591.605068:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787779591.605074:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e848f36940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874622525005824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779591.605097:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e848f36940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874622525005824:12345-0@lo:400:kworker.0 Request processed in 23us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779591.605102:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787779591.605119:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525005312 00000100:00100000:2.0:1787779591.605123:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525005312 00000100:00100000:2.0:1787779591.605142:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1787779591.605148:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+19:3305:x1874622525005312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779591.605172:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+19:3305:x1874622525005312:12345-0@lo:400:kworker.0 Request processed in 24us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779591.605177:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00080000:2.0:1787779591.605200:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787779591.605218:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e8516821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c28aae66-2825-42c5-8f52-61f687e868c9:3305:1874622525005312:0@lo:400:kworker.0 00000100:00100000:2.0:1787779591.605226:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e8516812c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874622525005824:0@lo:400:kworker.0 00000100:00100000:2.0:1787779591.605245:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e8516803c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874622525005440:0@lo:400:kworker.0 00000100:00100000:3.0:1787779591.605752:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525005952 00000100:00100000:3.0:1787779591.605758:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525005952 00000100:00100000:3.0:1787779591.606140:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787779591.606150:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e848f361c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874622525005952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779591.606207:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e848f361c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874622525005952:12345-0@lo:400:kworker.0 Request processed in 60us (1514us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779591.606214:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787779591.606273:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e851680f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874622525005568:0@lo:400:kworker.0 00010000:00080000:3.0:1787779591.606317:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e851682940 x1874622525005952/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779607 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779591.606328:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e851682940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874622525005952:0@lo:400:kworker.0 00000100:00080000:2.0:1787779591.607114:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787779591.794951:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779592.114990:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ab35680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622525006080:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787779592.115296:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779592.125752:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525006080 00000100:00100000:0.0:1787779592.125769:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525006080 00000100:00100000:0.0:1787779592.125845:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787779592.125856:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ab352c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622525006080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787779592.125902:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787779592.126011:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ab352c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622525006080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 156us (10774us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779592.126019:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:0.0:1787779592.126516:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e87ab35680 x1874622525006080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779608 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779592.126537:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ab35680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622525006080:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787779592.822275:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787779593.762059:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:1.0:1787779593.762086:0:5857:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000004:00080000:1.0:1787779593.762112:0:5857:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:1.0:1787779593.762482:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787779593.762505:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e848f34780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622525006208:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787779593.762587:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779593.762789:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525006208 00000100:00100000:2.0:1787779593.762797:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525006208 00000100:00100000:2.0:1787779593.762871:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787779593.762880:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ab36940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622525006208:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787779593.762906:0:6681:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:2.0:1787779593.762939:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a8f5a03, atime: 0x6a8f5a03, ctime: 0x6a8f5a03, blocks: 0x1 00010000:00010000:2.0:1787779593.762947:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a955fbc/0x9e63ba8af68891a5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779593.762964:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=359s v=(0 0) 00010000:00010000:2.0:1787779593.762969:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787779593.762977:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a955fbc/0x9e63ba8af68891a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779593.762996:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a955fbc/0x9e63ba8af68891a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779593.763007:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a955fbc/0x9e63ba8af68891a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779593.763015:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a955fbc/0x9e63ba8af68891a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779593.763032:0:6681:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787779593.763703:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ab36940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3306:x1874622525006208:12345-0@lo:6:osp-syn-0-0.0 Request processed in 822us (1114us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787779593.763745:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1787779593.764222:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787779593.764234:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787779593.764242:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a955fbc/0x9e63ba8af68891a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779593.764253:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87aa66800 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:1.0:1787779593.764257:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a955fbc/0x9e63ba8af68891a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779593.764276:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a955fbc/0x9e63ba8af68891a5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779593.764299:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a955fbc/0x9e63ba8af68891a5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779593.764307:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a955fbc/0x9e63ba8af68891a5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779593.764337:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779593.764339:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779593.764341:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787779593.764392:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98e848f34780/2, rc 0, transno 4294967300 00000100:00100000:1.0:1787779593.764400:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e848f34780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622525006208:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1787779593.843161:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779593.893681:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779593.893756:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779593.893802:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779593.893843:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779593.893878:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505047808 00000100:00100000:3.0:1787779593.893888:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505047808 00000100:00100000:3.0:1787779593.893955:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 64 00000100:00100000:3.0:1787779593.893965:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e851681680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+5:2357:x1874622505047808:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:3.0:1787779593.894035:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e851681680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+5:2357:x1874622505047808:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 72us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779593.894042:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 64 00000100:00080000:3.0:1787779593.894124:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787779593.894380:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505047552 00000100:00100000:1.0:1787779593.894386:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505047552 00000100:00100000:1.0:1787779593.894437:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 255 00000100:00100000:1.0:1787779593.894447:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+13:2357:x1874622505047552:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:1.0:1787779593.894488:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+13:2357:x1874622505047552:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 43us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779593.894496:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 255 00000100:00100000:2.0:1787779593.895396:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505047680 00000100:00100000:2.0:1787779593.895413:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505047680 00000100:00100000:2.0:1787779593.895470:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505047936 00000100:00100000:2.0:1787779593.895473:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505047936 00000100:00100000:2.0:1787779593.895502:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 113 00000100:00100000:2.0:1787779593.895509:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e851682940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+5:2357:x1874622505047680:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:2.0:1787779593.895568:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e851682940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+5:2357:x1874622505047680:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 59us (1900us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779593.895576:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 113 00000100:00100000:2.0:1787779593.895594:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 114 00000100:00100000:2.0:1787779593.895600:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e851680f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54e1e60c-3037-4ae3-b045-838eb9e0ad0b+5:2357:x1874622505047936:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:2.0:1787779593.895625:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e851680f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54e1e60c-3037-4ae3-b045-838eb9e0ad0b+5:2357:x1874622505047936:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 26us (1870us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779593.895630:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 114 00000100:00080000:1.0:1787779593.895702:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787779594.867265:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779595.704156:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787779595.704193:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ec18f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874622525006336:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787779595.704281:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779595.704358:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525006336 00000100:00100000:3.0:1787779595.704367:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525006336 00000100:00100000:3.0:1787779595.704940:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787779595.704951:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e851680780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1874622525006336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787779595.704997:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787779595.705065:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e851680780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1874622525006336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (784us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779595.705081:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:3.0:1787779595.705106:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787779595.705148:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ec18f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874622525006336:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787779595.891572:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787779596.388499:0:11613:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:1.0:1787779596.726274:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787779596.726399:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787779596.726427:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f538f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874622525006848:0@lo:400:kworker.0 00000100:00100000:0.0:1787779596.726510:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779596.726583:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525006848 00000100:00100000:0.0:1787779596.726592:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525006848 00000100:00100000:0.0:1787779596.726644:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787779596.726655:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f6b7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1874622525006848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779596.726738:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f6b7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1874622525006848:12345-0@lo:400:kworker.0 Request processed in 57us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779596.726746:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787779596.726791:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f538f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874622525006848:0@lo:400:kworker.0 00000100:00100000:0.0:1787779596.726833:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ec1b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874622525006592:0@lo:400:kworker.0 00000100:00100000:0.0:1787779596.726863:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779596.726887:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787779596.726893:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ec18f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874622525006720:0@lo:400:kworker.0 00000100:00100000:0.0:1787779596.726915:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779596.726944:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525006592 00000100:00100000:0.0:1787779596.726948:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525006592 00000100:00100000:0.0:1787779596.726978:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525006720 00000100:00100000:0.0:1787779596.726981:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525006720 00000100:00100000:0.0:1787779596.727012:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787779596.727019:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f6b6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874622525006592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779596.727066:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f6b6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874622525006592:12345-0@lo:400:kworker.0 Request processed in 47us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779596.727072:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787779596.727086:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787779596.727092:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f6b5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874622525006720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779596.727118:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f6b5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874622525006720:12345-0@lo:400:kworker.0 Request processed in 26us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779596.727123:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787779596.727154:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ec18f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874622525006720:0@lo:400:kworker.0 00000100:00100000:0.0:1787779596.727164:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ec1b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874622525006592:0@lo:400:kworker.0 00000100:00080000:0.0:1787779596.727205:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787779596.734096:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ec1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c28aae66-2825-42c5-8f52-61f687e868c9:3304:1874622525006464:0@lo:400:kworker.0 00000100:00100000:0.0:1787779596.734180:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779596.735262:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525006464 00000100:00100000:3.0:1787779596.735275:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525006464 00000100:00100000:3.0:1787779596.735328:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1787779596.735338:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e844dc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+19:3304:x1874622525006464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779596.735431:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e844dc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+19:3304:x1874622525006464:12345-0@lo:400:kworker.0 Request processed in 95us (1251us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779596.735439:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1787779596.736966:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787779596.737062:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f538f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874622525006976:0@lo:400:kworker.0 00000100:00100000:1.0:1787779596.737130:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779596.737187:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525006976 00000100:00100000:1.0:1787779596.737195:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525006976 00000100:00100000:1.0:1787779596.737251:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787779596.737260:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ab37840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874622525006976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779596.737318:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ab37840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874622525006976:12345-0@lo:400:kworker.0 Request processed in 59us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779596.737326:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:1.0:1787779596.737348:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787779596.737392:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f538f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874622525006976:0@lo:400:kworker.0 00000100:00100000:2.0:1787779596.737475:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ab18b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622525007104:0@lo:400:kworker.0 00000100:00100000:2.0:1787779596.737510:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779596.737616:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ec1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c28aae66-2825-42c5-8f52-61f687e868c9:3304:1874622525006464:0@lo:400:kworker.0 00000100:00100000:3.0:1787779596.759662:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525007104 00000100:00100000:3.0:1787779596.759681:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525007104 00000100:00100000:3.0:1787779596.763584:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787779596.763600:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ab1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622525007104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779596.763731:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ab1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622525007104:12345-0@lo:400:kworker.0 Request processed in 135us (26220us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779596.763738:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:1.0:1787779596.770886:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787779596.778210:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e87ab18b40 x1874622525007104/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779612 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779596.778229:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ab18b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622525007104:0@lo:400:kworker.0 00010000:00010000:3.0:1787779596.915023:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779597.234996:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f6b4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622525007232:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787779597.235073:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779597.235241:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525007232 00000100:00100000:0.0:1787779597.235249:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525007232 00000100:00100000:0.0:1787779597.235309:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787779597.235319:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e851680000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622525007232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787779597.235363:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787779597.235410:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e851680000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622525007232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779597.235425:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:3.0:1787779597.236155:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e87f6b4f00 x1874622525007232/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779613 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779597.236179:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f6b4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622525007232:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787779597.940738:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787779597.984379:0:11663:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe81bbfdb0 20000000:00000080:0.0:1787779597.984401:0:11663:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98e88204f400 uarg=0000000000000000 20000000:01000000:0.0:1787779597.984445:0:11663:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1787779597.984453:0:11663:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1787779597.984459:0:11663:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1787779597.987693:0:11664:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1787779597.988253:0:11663:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:1.0:1787779597.997406:0:11663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:1.0:1787779597.997466:0:11663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:1.0:1787779597.997555:0:11663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:1.0:1787779597.997576:0:11663:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787779597.997596:0:11663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98e87a98a600/0x9e63ba8af68891ac lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779597.997615:0:11663:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98e848f68400/0x9e63ba8af688904e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af6889047 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779597.997623:0:11663:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98e87aa66200/0x9e63ba8af688905c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af6889055 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779597.997629:0:11663:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98e8429d5800/0x9e63ba8af688906a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af6889063 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779597.997639:0:11663:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98e87aa67200/0x9e63ba8af6889071 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedabdf expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779597.997656:0:11663:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98e87a98ae00/0x9e63ba8af6889078 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedabe6 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779597.997663:0:11663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98e87a98a600/0x9e63ba8af68891ac lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779597.997704:0:11663:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98e87a98ae00/0x9e63ba8af6889078 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedabe6 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779597.997753:0:11663:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98e87a98ae00/0x9e63ba8af6889078 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedabe6 expref: 12 pid: 5830 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779597.997769:0:11663:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ab370c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11663:1874622525007360:192.168.201.9@tcp:104: 00010000:00010000:1.0:1787779597.997889:0:11663:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98e87aa67200/0x9e63ba8af6889071 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedabdf expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779597.997898:0:11663:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98e87aa67200/0x9e63ba8af6889071 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedabdf expref: 12 pid: 5831 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779597.997907:0:11663:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ab34780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11663:1874622525007488:192.168.201.9@tcp:104: 00010000:00010000:1.0:1787779597.997941:0:11663:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98e8429d5800/0x9e63ba8af688906a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9e63ba8af6889063 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779597.997949:0:11663:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98e8429d5800/0x9e63ba8af688906a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9e63ba8af6889063 expref: 18 pid: 5828 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779597.997959:0:11663:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ab34000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11663:1874622525007616:0@lo:104: 00000100:00100000:1.0:1787779597.998001:0:11663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787779597.998053:0:11663:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98e87aa66200/0x9e63ba8af688905c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9e63ba8af6889055 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779597.998061:0:11663:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98e87aa66200/0x9e63ba8af688905c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9e63ba8af6889055 expref: 18 pid: 5830 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779597.998068:0:11663:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ab36580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11663:1874622525007744:0@lo:104: 00000100:00100000:1.0:1787779597.998091:0:11663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787779597.998111:0:11663:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98e848f68400/0x9e63ba8af688904e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9e63ba8af6889047 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779597.998119:0:11663:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98e848f68400/0x9e63ba8af688904e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9e63ba8af6889047 expref: 18 pid: 5831 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779597.998128:0:11663:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ab35680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11663:1874622525007872:0@lo:104: 00000100:00100000:1.0:1787779597.998151:0:11663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779597.998161:0:11663:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e84764e780 going to sleep for 11 seconds 00000100:00100000:0.0:1787779597.998825:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787779597.998839:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525007616 00000100:00100000:0.0:1787779597.998846:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525007616 00000100:00100000:0.0:1787779597.998883:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525007744 00000100:00100000:0.0:1787779597.998885:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525007744 00000100:00100000:0.0:1787779597.998895:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525007872 00000100:00100000:0.0:1787779597.998897:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525007872 00000100:00100000:0.0:1787779597.998910:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787779597.998919:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ab36d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c28aae66-2825-42c5-8f52-61f687e868c9+5:11663:x1874622525007616:12345-0@lo:104: 00010000:00010000:0.0:1787779597.998933:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.109@tcp lock: ffff98e87aa66400/0x9e63ba8af6889063 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9e63ba8af688906a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779597.999013:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787779597.999019:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ab36d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c28aae66-2825-42c5-8f52-61f687e868c9+5:11663:x1874622525007616:12345-0@lo:104: Request processed in 101us (1018us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779597.999025:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787779597.999044:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787779597.999050:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ab35e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c28aae66-2825-42c5-8f52-61f687e868c9+4:11663:x1874622525007744:12345-0@lo:104: 00010000:00010000:0.0:1787779597.999058:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.109@tcp lock: ffff98e87aa67800/0x9e63ba8af6889055 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9e63ba8af688905c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779597.999104:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787779597.999110:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ab35e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c28aae66-2825-42c5-8f52-61f687e868c9+4:11663:x1874622525007744:12345-0@lo:104: Request processed in 61us (1018us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779597.999116:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787779597.999127:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787779597.999132:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e873975c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c28aae66-2825-42c5-8f52-61f687e868c9+3:11663:x1874622525007872:12345-0@lo:104: 00010000:00010000:0.0:1787779597.999139:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.109@tcp lock: ffff98e87aa66000/0x9e63ba8af6889047 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9e63ba8af688904e expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779597.999168:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787779597.999173:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e873975c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c28aae66-2825-42c5-8f52-61f687e868c9+3:11663:x1874622525007872:12345-0@lo:104: Request processed in 41us (1021us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779597.999178:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1787779597.999218:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787779597.999224:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff98e87aa66400/0x9e63ba8af6889063 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9e63ba8af688906a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779597.999231:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87aa66400 already unused, calling callback (ffffffffc1cd5c20) 10000000:00010000:0.0:1787779597.999234:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff98e87aa66400/0x9e63ba8af6889063 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9e63ba8af688906a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779597.999242:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff98e87aa66400/0x9e63ba8af6889063 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9e63ba8af688906a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787779597.999249:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff98e87aa66400/0x9e63ba8af6889063 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9e63ba8af688906a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787779597.999256:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787779597.999298:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.109@tcp lock: ffff98e87aa66400/0x9e63ba8af6889063 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af688906a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779597.999304:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787779597.999325:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff98e87aa66400/0x9e63ba8af6889063 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af688906a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779597.999344:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff98e87aa66400/0x9e63ba8af6889063 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af688906a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779597.999356:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787779597.999359:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff98e87aa67800/0x9e63ba8af6889055 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9e63ba8af688905c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779597.999364:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87aa67800 already unused, calling callback (ffffffffc1cd5c20) 10000000:00010000:0.0:1787779597.999367:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff98e87aa67800/0x9e63ba8af6889055 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9e63ba8af688905c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779597.999373:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff98e87aa67800/0x9e63ba8af6889055 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9e63ba8af688905c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787779597.999379:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff98e87aa67800/0x9e63ba8af6889055 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9e63ba8af688905c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787779597.999384:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787779597.999395:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.109@tcp lock: ffff98e87aa67800/0x9e63ba8af6889055 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af688905c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779597.999401:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787779597.999406:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff98e87aa67800/0x9e63ba8af6889055 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af688905c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779597.999421:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff98e87aa67800/0x9e63ba8af6889055 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af688905c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779597.999429:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787779597.999432:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff98e87aa66000/0x9e63ba8af6889047 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9e63ba8af688904e expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779597.999437:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87aa66000 already unused, calling callback (ffffffffc1cd5c20) 10000000:00010000:0.0:1787779597.999440:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff98e87aa66000/0x9e63ba8af6889047 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9e63ba8af688904e expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779597.999447:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff98e87aa66000/0x9e63ba8af6889047 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9e63ba8af688904e expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787779597.999454:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff98e87aa66000/0x9e63ba8af6889047 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9e63ba8af688904e expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787779597.999459:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787779597.999469:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.109@tcp lock: ffff98e87aa66000/0x9e63ba8af6889047 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af688904e expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779597.999475:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787779597.999489:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff98e87aa66000/0x9e63ba8af6889047 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af688904e expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779597.999496:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff98e87aa66000/0x9e63ba8af6889047 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af688904e expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779597.999525:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779597.999532:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779597.999534:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779597.999540:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779597.999545:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779597.999556:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f6b4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c28aae66-2825-42c5-8f52-61f687e868c9:3304:1874622525008000:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787779597.999585:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779597.999607:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787779597.999612:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855b3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c28aae66-2825-42c5-8f52-61f687e868c9:3304:1874622525008128:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787779597.999632:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779597.999654:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855b3d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c28aae66-2825-42c5-8f52-61f687e868c9:3306:1874622525008256:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787779597.999676:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779597.999703:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525008000 00000100:00100000:0.0:1787779597.999707:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525008000 00010000:00010000:0.0:1787779597.999741:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98e8429d5800/0x9e63ba8af688906a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9e63ba8af6889063 expref: 19 pid: 5828 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779597.999760:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525008128 00000100:00100000:0.0:1787779597.999763:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525008128 00010000:00010000:0.0:1787779597.999773:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98e87aa66200/0x9e63ba8af688905c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9e63ba8af6889055 expref: 20 pid: 5830 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779597.999780:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525008256 00000100:00100000:0.0:1787779597.999782:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525008256 00010000:00010000:0.0:1787779597.999788:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98e848f68400/0x9e63ba8af688904e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9e63ba8af6889047 expref: 21 pid: 5831 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779597.999797:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787779597.999802:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec18780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c28aae66-2825-42c5-8f52-61f687e868c9+21:3304:x1874622525008000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787779597.999810:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787779597.999822:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98e8429d5800/0x9e63ba8af688906a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9e63ba8af6889063 expref: 21 pid: 5828 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779597.999830:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98e8429d5800/0x9e63ba8af688906a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9e63ba8af6889063 expref: 21 pid: 5828 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779597.999844:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787779597.999871:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec18780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c28aae66-2825-42c5-8f52-61f687e868c9+21:3304:x1874622525008000:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779597.999878:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787779597.999891:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787779597.999897:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec1b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c28aae66-2825-42c5-8f52-61f687e868c9+20:3304:x1874622525008128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787779597.999904:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787779597.999908:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98e87aa66200/0x9e63ba8af688905c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9e63ba8af6889055 expref: 20 pid: 5830 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779597.999916:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98e87aa66200/0x9e63ba8af688905c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9e63ba8af6889055 expref: 20 pid: 5830 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779597.999925:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787779597.999945:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec1b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c28aae66-2825-42c5-8f52-61f687e868c9+20:3304:x1874622525008128:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779597.999951:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787779597.999962:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787779597.999968:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e847d97850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c28aae66-2825-42c5-8f52-61f687e868c9+19:3306:x1874622525008256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787779597.999975:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787779597.999979:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98e848f68400/0x9e63ba8af688904e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9e63ba8af6889047 expref: 19 pid: 5831 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779597.999998:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98e848f68400/0x9e63ba8af688904e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9e63ba8af6889047 expref: 19 pid: 5831 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779598.000007:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787779598.000033:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e847d97850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c28aae66-2825-42c5-8f52-61f687e868c9+19:3306:x1874622525008256:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779598.000039:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787779598.000092:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855b3d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c28aae66-2825-42c5-8f52-61f687e868c9:3306:1874622525008256:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787779598.000112:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855b3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c28aae66-2825-42c5-8f52-61f687e868c9:3304:1874622525008128:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787779598.000118:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f6b4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c28aae66-2825-42c5-8f52-61f687e868c9:3304:1874622525008000:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787779598.001137:0:11663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e8429d5800/0x9e63ba8af688906a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9e63ba8af6889063 expref: 18 pid: 5828 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779598.001155:0:11663:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ab34000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11663:1874622525007616:0@lo:104: 00010000:00010000:1.0:1787779598.001166:0:11663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e87aa66200/0x9e63ba8af688905c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9e63ba8af6889055 expref: 17 pid: 5830 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779598.001175:0:11663:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ab36580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11663:1874622525007744:0@lo:104: 00010000:00010000:1.0:1787779598.001185:0:11663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e848f68400/0x9e63ba8af688904e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9e63ba8af6889047 expref: 16 pid: 5831 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779598.001193:0:11663:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ab35680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11663:1874622525007872:0@lo:104: 00000100:00100000:1.0:1787779598.031034:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779598.031061:0:11663:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ab370c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11663:1874622525007360:192.168.201.9@tcp:104: 00000100:00100000:3.0:1787779598.031080:0:11663:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ab34780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11663:1874622525007488:192.168.201.9@tcp:104: 00000100:00100000:1.0:1787779598.031086:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00010000:00010000:3.0:1787779598.031117:0:11663:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98e87a98a600/0x9e63ba8af68891ac lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779598.031181:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505048064 00000100:00100000:0.0:1787779598.031187:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505048064 00010000:00010000:0.0:1787779598.031223:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98e87a98ae00/0x9e63ba8af6889078 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedabe6 expref: 13 pid: 5830 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779598.031370:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505048192 00000100:00100000:0.0:1787779598.031374:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505048192 00010000:00010000:0.0:1787779598.031389:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98e87aa67200/0x9e63ba8af6889071 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedabdf expref: 14 pid: 5831 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779598.036799:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 33 00000100:00100000:3.0:1787779598.036826:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ab343c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+14:2359:x1874622505048064:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787779598.036849:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787779598.036860:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98e87a98ae00/0x9e63ba8af6889078 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedabe6 expref: 14 pid: 5830 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779598.036875:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98e87a98ae00/0x9e63ba8af6889078 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedabe6 expref: 14 pid: 5830 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779598.036896:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e87a98ae00/0x9e63ba8af6889078 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedabe6 expref: 14 pid: 5830 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779598.036913:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787779598.037281:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ab343c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+13:2359:x1874622505048064:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 467us (6253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779598.037291:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 33 00000100:00100000:3.0:1787779598.037326:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 34 00000100:00100000:3.0:1787779598.037344:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ab37480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+12:2360:x1874622505048192:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787779598.037353:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787779598.037359:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98e87aa67200/0x9e63ba8af6889071 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedabdf expref: 12 pid: 5831 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779598.037369:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98e87aa67200/0x9e63ba8af6889071 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedabdf expref: 12 pid: 5831 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779598.037397:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e87aa67200/0x9e63ba8af6889071 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedabdf expref: 12 pid: 5831 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779598.037410:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98e87a98a600/0x9e63ba8af68891ac lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779598.037419:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e87a98a600/0x9e63ba8af68891ac lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779598.037437:0:5821:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98e87a98a600/0x9e63ba8af68891ac lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779598.037444:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98e87a98a600/0x9e63ba8af68891ac lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779598.037451:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98e87a98a600/0x9e63ba8af68891ac lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779598.037458:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98e87a98a600/0x9e63ba8af68891ac lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779598.037464:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87a98a600 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:3.0:1787779598.037468:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98e87a98a600/0x9e63ba8af68891ac lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779598.037488:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98e87a98a600/0x9e63ba8af68891ac lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779598.037514:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98e87a98a600/0x9e63ba8af68891ac lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779598.037536:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787779598.037557:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ab37480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+11:2360:x1874622505048192:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 215us (6470us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779598.037564:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 34 00010000:00010000:3.0:1787779598.037601:0:11663:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98e87a98a600/0x9e63ba8af68891ac lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779598.037609:0:11663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98e87a98a600/0x9e63ba8af68891ac lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779598.037615:0:11663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e87a98a600/0x9e63ba8af68891ac lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779598.975140:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787779598.980139:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000100:00100000:0.0:1787779599.008241:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779599.008282:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779599.008323:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779599.008361:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779599.008397:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505048448 00000100:00100000:0.0:1787779599.008407:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505048448 00000100:00100000:0.0:1787779599.008466:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505048704 00000100:00100000:0.0:1787779599.008482:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505048704 00000100:00100000:0.0:1787779599.008514:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 118 00000100:00100000:0.0:1787779599.008523:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+5:2358:x1874622505048448:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:0.0:1787779599.008621:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+5:2358:x1874622505048448:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 98us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779599.008629:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 118 00000100:00100000:0.0:1787779599.008659:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 119 00000100:00100000:0.0:1787779599.008666:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec1b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54e1e60c-3037-4ae3-b045-838eb9e0ad0b+5:2358:x1874622505048704:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:0.0:1787779599.008701:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec1b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54e1e60c-3037-4ae3-b045-838eb9e0ad0b+5:2358:x1874622505048704:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 35us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779599.008707:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 119 00000100:00080000:0.0:1787779599.008756:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787779599.009163:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505048576 00000100:00100000:2.0:1787779599.009168:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505048576 00000100:00100000:2.0:1787779599.009223:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 67 00000100:00100000:2.0:1787779599.009232:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec18780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+5:2358:x1874622505048576:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:2.0:1787779599.009270:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec18780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+5:2358:x1874622505048576:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 39us (987us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779599.009284:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 67 00000100:00100000:3.0:1787779599.009542:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505048320 00000100:00100000:3.0:1787779599.009547:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505048320 00000100:00100000:3.0:1787779599.009620:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 257 00000100:00100000:3.0:1787779599.009628:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e844dc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+11:2358:x1874622505048320:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:3.0:1787779599.010034:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e844dc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+11:2358:x1874622505048320:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 406us (1803us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779599.010050:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 257 00000100:00080000:0.0:1787779599.010538:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787779599.650237:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779599.650345:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505048832 00000100:00100000:1.0:1787779599.650357:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505048832 00000100:00100000:1.0:1787779599.650418:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 258 00000100:00100000:1.0:1787779599.650428:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e844dc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+11:5601:x1874622505048832:12345-192.168.201.9@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787779599.650447:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779599.650468:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e87a98ac00/0x9e63ba8af68891b3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedac33 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779599.650500:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e87a98ac00/0x9e63ba8af68891b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac33 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779599.650511:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e87a98ac00/0x9e63ba8af68891b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac33 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779599.650519:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87a98ac00, rc 0) 00000100:00100000:1.0:1787779599.650607:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e844dc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+12:5601:x1874622505048832:12345-192.168.201.9@tcp:101:ll_cfg_requeue.0 Request processed in 180us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779599.650615:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 258 00000100:00100000:1.0:1787779599.653167:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779599.653413:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505048960 00000100:00100000:3.0:1787779599.653422:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505048960 00000100:00100000:3.0:1787779599.653473:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 259 00000100:00100000:3.0:1787779599.653483:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842effc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+12:5601:x1874622505048960:12345-192.168.201.9@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787779599.653829:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842effc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+12:5601:x1874622505048960:12345-192.168.201.9@tcp:501:ll_cfg_requeue.0 Request processed in 347us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779599.653846:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 259 00000100:00100000:3.0:1787779599.655740:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779599.656046:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505049088 00000100:00100000:2.0:1787779599.656055:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505049088 00000100:00100000:2.0:1787779599.656112:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 260 00000100:00100000:2.0:1787779599.656123:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842efdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+12:5601:x1874622505049088:12345-192.168.201.9@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787779599.656373:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842efdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+12:5601:x1874622505049088:12345-192.168.201.9@tcp:503:ll_cfg_requeue.0 Request processed in 252us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779599.656381:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 260 00000100:00100000:0.0:1787779599.660586:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779599.660884:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505049216 00000100:00100000:1.0:1787779599.660895:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505049216 00000100:00100000:1.0:1787779599.660959:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 261 00000100:00100000:1.0:1787779599.660969:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842efc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+12:9976:x1874622505049216:12345-192.168.201.9@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787779599.661222:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842efc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+12:9976:x1874622505049216:12345-192.168.201.9@tcp:502:llog_process_th.0 Request processed in 254us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779599.661232:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 261 00000100:00100000:1.0:1787779599.668507:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779599.668629:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505049344 00000100:00100000:3.0:1787779599.668642:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505049344 00000100:00100000:3.0:1787779599.668695:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 262 00000100:00100000:3.0:1787779599.668706:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842efcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+12:9976:x1874622505049344:12345-192.168.201.9@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787779599.669125:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842efcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+12:9976:x1874622505049344:12345-192.168.201.9@tcp:502:llog_process_th.0 Request processed in 418us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779599.669134:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 262 00000100:00100000:3.0:1787779599.684052:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779599.684267:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505049472 00000100:00100000:2.0:1787779599.684277:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505049472 00000100:00100000:2.0:1787779599.684341:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 263 00000100:00100000:2.0:1787779599.684351:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842eff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+12:5601:x1874622505049472:12345-192.168.201.9@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787779599.684368:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779599.684386:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e87aa67c00/0x9e63ba8af68891ba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedac3a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779599.684416:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e87aa67c00/0x9e63ba8af68891ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac3a expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779599.684427:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e87aa67c00/0x9e63ba8af68891ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac3a expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779599.684436:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87aa67c00, rc 0) 00000100:00100000:2.0:1787779599.684496:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842eff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+13:5601:x1874622505049472:12345-192.168.201.9@tcp:101:ll_cfg_requeue.0 Request processed in 146us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779599.684503:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 263 00000100:00100000:0.0:1787779599.693769:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779599.693872:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505049600 00000100:00100000:1.0:1787779599.693891:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505049600 00000100:00100000:1.0:1787779599.693960:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 264 00000100:00100000:1.0:1787779599.693971:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842eff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+13:5601:x1874622505049600:12345-192.168.201.9@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787779599.694312:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842eff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+13:5601:x1874622505049600:12345-192.168.201.9@tcp:501:ll_cfg_requeue.0 Request processed in 333us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779599.694320:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 264 00000100:00100000:1.0:1787779599.699678:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779599.699814:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505049728 00000100:00100000:3.0:1787779599.699827:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505049728 00000100:00100000:3.0:1787779599.699898:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 265 00000100:00100000:3.0:1787779599.699908:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842efe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+13:5601:x1874622505049728:12345-192.168.201.9@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787779599.700160:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842efe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+13:5601:x1874622505049728:12345-192.168.201.9@tcp:503:ll_cfg_requeue.0 Request processed in 252us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779599.700168:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 265 00000100:00100000:3.0:1787779599.707362:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779599.711993:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505049856 00000100:00100000:2.0:1787779599.712009:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505049856 00000100:00100000:2.0:1787779599.712090:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 266 00000100:00100000:2.0:1787779599.712101:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842efd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+13:9979:x1874622505049856:12345-192.168.201.9@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787779599.714122:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842efd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+13:9979:x1874622505049856:12345-192.168.201.9@tcp:502:llog_process_th.0 Request processed in 2009us (6757us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779599.714137:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 266 00000100:00100000:0.0:1787779599.727409:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779599.727514:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505049984 00000100:00100000:1.0:1787779599.727526:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505049984 00000100:00100000:1.0:1787779599.727586:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 267 00000100:00100000:1.0:1787779599.727597:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842efe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+13:9979:x1874622505049984:12345-192.168.201.9@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787779599.727954:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842efe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+13:9979:x1874622505049984:12345-192.168.201.9@tcp:502:llog_process_th.0 Request processed in 358us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779599.727963:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 267 10000000:01000000:3.0:1787779599.991041:0:5833:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787779599.991050:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98e87a56c800 from 7 10000000:01000000:3.0:1787779599.991056:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787779599.991110:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e8429d5a00/0x9e63ba8af68891c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779599.991122:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff98e8429d5a00/0x9e63ba8af68891c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779599.991154:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff98e8429d5a00/0x9e63ba8af68891c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779599.991180:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e851682d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622525008384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787779599.991254:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779599.991338:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e8450ff6c0 going to sleep for 11 seconds 00010000:00010000:0.0:1787779599.992352:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787779599.992833:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525008384 00000100:00100000:2.0:1787779599.992843:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525008384 00000100:00100000:2.0:1787779599.992910:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1787779599.992921:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842efd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+16:5833:x1874622525008384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787779599.992937:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779599.992955:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e87aa66c00/0x9e63ba8af68891c8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9e63ba8af68891c1 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779599.992983:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e87aa66c00/0x9e63ba8af68891c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9e63ba8af68891c1 expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779599.992994:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e87aa66c00/0x9e63ba8af68891c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af68891c1 expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779599.993004:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87aa66c00, rc 0) 00000100:00100000:2.0:1787779599.993099:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842efd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+17:5833:x1874622525008384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 179us (1844us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779599.993106:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1787779599.994042:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e851682d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622525008384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787779599.994064:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff98e8429d5a00/0x9e63ba8af68891c1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af68891c8 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779599.994075:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff98e8429d5a00/0x9e63ba8af68891c1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9e63ba8af68891c8 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779599.994146:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e851682d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622525008512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787779599.994189:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779599.994230:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e8450ff6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787779599.998918:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525008512 00000100:00100000:2.0:1787779599.998935:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525008512 00000100:00100000:2.0:1787779599.999009:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1787779599.999043:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842efc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+17:5833:x1874622525008512:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787779600.000388:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842efc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+17:5833:x1874622525008512:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1348us (6191us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779600.000400:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1787779600.014862:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e851682d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622525008512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787779600.014932:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ec18f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622525008640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787779600.015016:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779600.015078:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e848215b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787779600.018669:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525008640 00000100:00100000:2.0:1787779600.018683:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525008640 00000100:00100000:2.0:1787779600.018792:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1787779600.018804:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842eff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+17:5833:x1874622525008640:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787779600.019075:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842eff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+17:5833:x1874622525008640:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 272us (4057us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779600.019083:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1787779600.019792:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ec18f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622525008640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787779600.021541:0:11679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e851682580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c28aae66-2825-42c5-8f52-61f687e868c9:11679:1874622525008768:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787779600.021632:0:11679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779600.021682:0:11679:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e8474e16c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787779600.023451:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525008768 00000100:00100000:2.0:1787779600.023465:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525008768 00000100:00100000:2.0:1787779600.023535:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1787779600.023545:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842efe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+17:11679:x1874622525008768:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787779600.024978:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842efe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+17:11679:x1874622525008768:12345-0@lo:502:llog_process_th.0 Request processed in 1429us (3341us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779600.024991:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1787779600.025150:0:11679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e851682580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c28aae66-2825-42c5-8f52-61f687e868c9:11679:1874622525008768:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787779600.025188:0:11679:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787779600.025201:0:11679:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787779600.025203:0:11679:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787779600.025210:0:11679:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98e87a56c800 00000020:00000080:3.0:1787779600.025212:0:11679:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787779600.025351:0:11679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e851682580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c28aae66-2825-42c5-8f52-61f687e868c9:11679:1874622525008896:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787779600.025402:0:11679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779600.025449:0:11679:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e8474e16c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787779600.026454:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525008896 00000100:00100000:1.0:1787779600.026465:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525008896 00000100:00100000:1.0:1787779600.026524:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1787779600.026535:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842efec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+17:11679:x1874622525008896:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787779600.026842:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842efec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+17:11679:x1874622525008896:12345-0@lo:502:llog_process_th.0 Request processed in 307us (1438us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779600.026849:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1787779600.027409:0:11679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e851682580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c28aae66-2825-42c5-8f52-61f687e868c9:11679:1874622525008896:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787779600.027447:0:11679:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787779600.027455:0:11679:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787779600.027457:0:11679:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787779600.027462:0:11679:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1787779600.027988:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1787779600.028011:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787779600.028916:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e8429d5a00/0x9e63ba8af68891c1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af68891c8 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779600.028933:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff98e8429d5a00/0x9e63ba8af68891c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af68891c8 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787779600.028945:0:5833:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787779600.028955:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98e848ee5800 from 7 10000000:01000000:2.0:1787779600.028959:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787779600.028994:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e87aa66800/0x9e63ba8af68891cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779600.029002:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff98e87aa66800/0x9e63ba8af68891cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779600.029010:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff98e87aa66800/0x9e63ba8af68891cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779600.029379:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ab19a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622525009024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787779600.039956:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779600.040009:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e846ae8900 going to sleep for 11 seconds 00000100:00100000:3.0:1787779600.042302:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525009024 00000100:00100000:3.0:1787779600.042316:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525009024 00000100:00100000:3.0:1787779600.042396:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1787779600.042407:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842efc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+17:5833:x1874622525009024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787779600.042425:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779600.042445:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e8429d4200/0x9e63ba8af68891d6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9e63ba8af68891cf expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779600.042474:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e8429d4200/0x9e63ba8af68891d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9e63ba8af68891cf expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779600.042485:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e8429d4200/0x9e63ba8af68891d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af68891cf expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779600.042494:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e8429d4200, rc 0) 00000100:00100000:3.0:1787779600.042568:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842efc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+18:5833:x1874622525009024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 163us (2619us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779600.042575:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1787779600.049256:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ab19a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622525009024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787779600.049320:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff98e87aa66800/0x9e63ba8af68891cf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af68891d6 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779600.049333:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff98e87aa66800/0x9e63ba8af68891cf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9e63ba8af68891d6 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779600.049416:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ab34780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622525009152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787779600.049478:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779600.049524:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e85d939840 going to sleep for 11 seconds 00000100:00100000:1.0:1787779600.049548:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525009152 00000100:00100000:1.0:1787779600.049553:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525009152 00000100:00100000:1.0:1787779600.049595:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1787779600.049604:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842efd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+18:5833:x1874622525009152:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787779600.051431:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ab34780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622525009152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787779600.051483:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ab1a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622525009280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787779600.051532:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779600.051567:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e846ae8900 going to sleep for 11 seconds 00000100:00100000:3.0:1787779600.051629:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525009280 00000100:00100000:3.0:1787779600.051636:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525009280 00000100:00100000:3.0:1787779600.051681:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1787779600.051697:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ef8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+19:5833:x1874622525009280:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787779600.051891:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ef8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+19:5833:x1874622525009280:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 195us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779600.051899:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1787779600.052572:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ab1a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622525009280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787779600.052781:0:11680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ab1a1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c28aae66-2825-42c5-8f52-61f687e868c9:11680:1874622525009408:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787779600.052835:0:11680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779600.052859:0:11680:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e846ae8900 going to sleep for 11 seconds 00000100:00100000:1.0:1787779600.053603:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842efd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+18:5833:x1874622525009152:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1636us (1761us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779600.053613:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1787779600.056689:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525009408 00000100:00100000:3.0:1787779600.056706:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525009408 00000100:00100000:3.0:1787779600.056787:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1787779600.056798:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ef9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+18:11680:x1874622525009408:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787779600.057090:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ef9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+18:11680:x1874622525009408:12345-0@lo:502:llog_process_th.0 Request processed in 293us (4263us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779600.057099:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1787779600.060468:0:11680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ab1a1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c28aae66-2825-42c5-8f52-61f687e868c9:11680:1874622525009408:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787779600.060525:0:11680:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787779600.060539:0:11680:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787779600.060541:0:11680:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787779600.060549:0:11680:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98e848ee5800 00000020:00000080:2.0:1787779600.060551:0:11680:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787779600.060635:0:11680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ab1a1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c28aae66-2825-42c5-8f52-61f687e868c9:11680:1874622525009536:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787779600.060752:0:11680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779600.060792:0:11680:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e844c196c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787779600.062094:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525009536 00000100:00100000:1.0:1787779600.062103:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525009536 00000100:00100000:1.0:1787779600.062170:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1787779600.062180:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ef8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+18:11680:x1874622525009536:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787779600.062458:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ef8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+18:11680:x1874622525009536:12345-0@lo:502:llog_process_th.0 Request processed in 279us (1706us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779600.062466:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1787779600.063083:0:11680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ab1a1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c28aae66-2825-42c5-8f52-61f687e868c9:11680:1874622525009536:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787779600.063117:0:11680:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787779600.063124:0:11680:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787779600.063126:0:11680:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787779600.063133:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1787779600.063412:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1787779600.063431:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787779600.063441:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e87aa66800/0x9e63ba8af68891cf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af68891d6 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779600.063452:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff98e87aa66800/0x9e63ba8af68891cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af68891d6 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787779600.063462:0:5833:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787779600.063465:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98e846b05800 from 7 10000000:01000000:3.0:1787779600.063468:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787779600.063499:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e8429d4a00/0x9e63ba8af68891dd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779600.063506:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff98e8429d4a00/0x9e63ba8af68891dd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779600.063514:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff98e8429d4a00/0x9e63ba8af68891dd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779600.063542:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e851682580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622525009664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787779600.063589:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779600.063614:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e8505bbb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787779600.063915:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525009664 00000100:00100000:1.0:1787779600.063921:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525009664 00000100:00100000:1.0:1787779600.063963:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1787779600.063971:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842efb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+18:5833:x1874622525009664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787779600.063989:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779600.064003:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e87a98a200/0x9e63ba8af68891e4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9e63ba8af68891dd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779600.064023:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e87a98a200/0x9e63ba8af68891e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9e63ba8af68891dd expref: 19 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779600.064106:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e87a98a200/0x9e63ba8af68891e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af68891dd expref: 19 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779600.064116:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87a98a200, rc 0) 00000100:00100000:1.0:1787779600.064165:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842efb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+19:5833:x1874622525009664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 195us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779600.064172:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1787779600.067426:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e851682580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622525009664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787779600.067455:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff98e8429d4a00/0x9e63ba8af68891dd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af68891e4 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779600.067484:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff98e8429d4a00/0x9e63ba8af68891dd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9e63ba8af68891e4 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779600.067573:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ab1a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622525009792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787779600.067633:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779600.067680:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e844c196c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787779600.068066:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525009792 00000100:00100000:3.0:1787779600.068073:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525009792 00000100:00100000:3.0:1787779600.068121:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1787779600.068131:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842efb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+19:5833:x1874622525009792:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787779600.068382:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842efb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+19:5833:x1874622525009792:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 253us (749us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779600.068390:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1787779600.068466:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ab1a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622525009792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787779600.068505:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ab1a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622525009920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787779600.068541:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779600.068567:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e844c196c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787779600.068580:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525009920 00000100:00100000:2.0:1787779600.068584:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525009920 00000100:00100000:2.0:1787779600.068615:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1787779600.068623:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842efa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+19:5833:x1874622525009920:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787779600.068813:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842efa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+19:5833:x1874622525009920:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 190us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779600.068838:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1787779600.068873:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ab1a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c28aae66-2825-42c5-8f52-61f687e868c9:5833:1874622525009920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787779600.069037:0:11683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ab1a1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c28aae66-2825-42c5-8f52-61f687e868c9:11683:1874622525010048:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787779600.069069:0:11683:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779600.069089:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525010048 00000100:00100000:2.0:1787779600.069092:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525010048 00000100:00100000:2.0:1787779600.069112:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1787779600.069119:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ef9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+19:11683:x1874622525010048:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787779600.069264:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ef9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+19:11683:x1874622525010048:12345-0@lo:502:llog_process_th.0 Request processed in 145us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779600.069270:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1787779600.069313:0:11683:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e844c19a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787779600.069326:0:11683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ab1a1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c28aae66-2825-42c5-8f52-61f687e868c9:11683:1874622525010048:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787779600.069349:0:11683:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787779600.069359:0:11683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787779600.069361:0:11683:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787779600.069369:0:11683:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98e846b05800 00000020:00000080:2.0:1787779600.069371:0:11683:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787779600.069764:0:11683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ab1a1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c28aae66-2825-42c5-8f52-61f687e868c9:11683:1874622525010176:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787779600.069813:0:11683:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779600.069841:0:11683:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e844c19a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787779600.070333:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525010176 00000100:00100000:0.0:1787779600.070339:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525010176 00000100:00100000:0.0:1787779600.070390:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1787779600.070396:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842efa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+19:11683:x1874622525010176:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787779600.070607:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842efa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+19:11683:x1874622525010176:12345-0@lo:502:llog_process_th.0 Request processed in 210us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779600.070612:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1787779600.070985:0:11683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ab1a1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c28aae66-2825-42c5-8f52-61f687e868c9:11683:1874622525010176:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787779600.071014:0:11683:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787779600.071021:0:11683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787779600.071023:0:11683:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787779600.071028:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1787779600.074866:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1787779600.074923:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787779600.074936:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e8429d4a00/0x9e63ba8af68891dd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af68891e4 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779600.074969:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff98e8429d4a00/0x9e63ba8af68891dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af68891e4 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787779600.092639:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787779600.821641:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ab183c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622525010304:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787779600.821741:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779600.821884:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525010304 00000100:00100000:3.0:1787779600.821892:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525010304 00000100:00100000:3.0:1787779600.821959:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787779600.821969:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec18f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622525010304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787779600.822004:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787779600.822050:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec18f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622525010304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779600.822058:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:0.0:1787779600.822118:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787779600.822144:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:0.0:1787779600.822150:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98e848f34780, transno 4294967300 00000100:00100000:0.0:1787779600.822176:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ab183c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622525010304:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787779601.011035:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787779601.141100:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787779601.845453:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f6b4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874622525010560:0@lo:400:kworker.0 00000100:00100000:1.0:1787779601.845531:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779601.845590:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87aa54780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874622525011072:0@lo:400:kworker.0 00000100:00100000:1.0:1787779601.845617:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779601.845646:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787779601.845653:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f6b43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c28aae66-2825-42c5-8f52-61f687e868c9:3305:1874622525010432:0@lo:400:kworker.0 00000100:00100000:1.0:1787779601.845679:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779601.845700:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855b3d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874622525010944:0@lo:400:kworker.0 00000100:00100000:1.0:1787779601.845742:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779601.845771:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525010560 00000100:00100000:1.0:1787779601.845777:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525010560 00000100:00100000:1.0:1787779601.845844:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525010944 00000100:00100000:1.0:1787779601.845848:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525010944 00000100:00100000:1.0:1787779601.845874:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787779601.845882:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ab370c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874622525010560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779601.845932:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ab370c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874622525010560:12345-0@lo:400:kworker.0 Request processed in 50us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779601.845938:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787779601.845956:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787779601.845962:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ab36580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874622525010944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779601.845988:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ab36580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874622525010944:12345-0@lo:400:kworker.0 Request processed in 27us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779601.845994:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:1.0:1787779601.846013:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787779601.846041:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855b3d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874622525010944:0@lo:400:kworker.0 00000100:00100000:1.0:1787779601.846052:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f6b4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874622525010560:0@lo:400:kworker.0 00000100:00100000:3.0:1787779601.846474:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f6b4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874622525010688:0@lo:400:kworker.0 00000100:00100000:3.0:1787779601.846507:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779601.846555:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525011072 00000100:00100000:3.0:1787779601.846560:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525011072 00000100:00100000:3.0:1787779601.846598:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787779601.846605:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ab35680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874622525011072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779601.846644:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ab35680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874622525011072:12345-0@lo:400:kworker.0 Request processed in 40us (1027us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779601.846650:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787779601.846668:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525010432 00000100:00100000:3.0:1787779601.846672:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525010432 00000100:00100000:3.0:1787779601.846696:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1787779601.846702:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ef9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+19:3305:x1874622525010432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779601.846758:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ef9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+19:3305:x1874622525010432:12345-0@lo:400:kworker.0 Request processed in 56us (1078us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779601.846765:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00080000:3.0:1787779601.846793:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787779601.846820:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f6b43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c28aae66-2825-42c5-8f52-61f687e868c9:3305:1874622525010432:0@lo:400:kworker.0 00010000:00080000:3.0:1787779601.846834:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e87aa54780 x1874622525011072/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779617 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779601.846845:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87aa54780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874622525011072:0@lo:400:kworker.0 00000100:00100000:1.0:1787779601.846968:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525010688 00000100:00100000:1.0:1787779601.846972:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525010688 00000100:00100000:1.0:1787779601.847010:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787779601.847016:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e851682580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874622525010688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779601.847049:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e851682580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874622525010688:12345-0@lo:400:kworker.0 Request processed in 33us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779601.847054:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787779601.847078:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f6b4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874622525010688:0@lo:400:kworker.0 00000100:00100000:0.0:1787779601.847146:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855b3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622525010816:0@lo:400:kworker.0 00000100:00100000:0.0:1787779601.847179:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779601.847506:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525010816 00000100:00100000:1.0:1787779601.847511:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525010816 00000100:00100000:1.0:1787779601.847547:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787779601.847565:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87aa57840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622525010816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779601.847603:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87aa57840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622525010816:12345-0@lo:400:kworker.0 Request processed in 40us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779601.847608:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:3.0:1787779601.849782:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787779601.852591:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855b3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622525010816:0@lo:400:kworker.0 00010000:00010000:2.0:1787779602.036706:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779602.355657:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87aa54780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622525011200:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787779602.355756:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779602.356231:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525011200 00000100:00100000:3.0:1787779602.356240:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525011200 00000100:00100000:3.0:1787779602.356302:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787779602.356311:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ab34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622525011200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787779602.356346:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787779602.356416:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ab34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622525011200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779602.356436:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:0.0:1787779602.356963:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e87aa54780 x1874622525011200/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779618 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779602.356982:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87aa54780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622525011200:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787779603.059085:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779604.083373:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779604.129304:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779604.129350:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779604.129382:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779604.129417:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779604.129454:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505050240 00000100:00100000:1.0:1787779604.129474:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505050240 00000100:00100000:1.0:1787779604.129548:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505050496 00000100:00100000:1.0:1787779604.129552:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505050496 00000100:00100000:1.0:1787779604.129575:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 123 00000100:00100000:1.0:1787779604.129585:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ab35e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+5:2359:x1874622505050240:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:1.0:1787779604.129667:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ab35e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+5:2359:x1874622505050240:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 83us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779604.129675:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 123 00000100:00100000:1.0:1787779604.129692:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 124 00000100:00100000:1.0:1787779604.129698:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ab34780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54e1e60c-3037-4ae3-b045-838eb9e0ad0b+5:2359:x1874622505050496:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:1.0:1787779604.129767:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ab34780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54e1e60c-3037-4ae3-b045-838eb9e0ad0b+5:2359:x1874622505050496:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 69us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779604.129774:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 124 00000100:00080000:1.0:1787779604.129791:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787779604.130695:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505050368 00000100:00100000:3.0:1787779604.130702:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505050368 00000100:00100000:3.0:1787779604.130800:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 70 00000100:00100000:3.0:1787779604.130809:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ab36d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+5:2359:x1874622505050368:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:3.0:1787779604.130876:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ab36d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+5:2359:x1874622505050368:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 68us (1525us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779604.130883:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 70 00000100:00080000:1.0:1787779604.131553:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787779604.131691:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505050112 00000100:00100000:2.0:1787779604.131698:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505050112 00000100:00100000:2.0:1787779604.131785:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 284 00000100:00100000:2.0:1787779604.131794:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ef8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+13:2359:x1874622505050112:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:2.0:1787779604.131836:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ef8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+13:2359:x1874622505050112:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 44us (2543us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779604.131852:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 284 00010000:00010000:2.0:1787779605.106947:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779605.940288:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ab18f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622525011328:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787779605.940365:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779605.940886:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525011328 00000100:00100000:3.0:1787779605.940895:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525011328 00000100:00100000:3.0:1787779605.940978:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787779605.940988:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87aa54780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622525011328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787779605.941026:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787779605.941078:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87aa54780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622525011328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779605.941085:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:2.0:1787779605.941306:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787779605.941400:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ab18f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622525011328:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787779606.131073:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779606.963805:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ab19680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c28aae66-2825-42c5-8f52-61f687e868c9:3304:1874622525011456:0@lo:400:kworker.0 00000100:00100000:0.0:1787779606.963899:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779606.964063:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525011456 00000100:00100000:3.0:1787779606.964080:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525011456 00000100:00100000:3.0:1787779606.964140:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1787779606.964148:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842efb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+19:3304:x1874622525011456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779606.964837:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ab192c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874622525011584:0@lo:400:kworker.0 00000100:00100000:1.0:1787779606.964875:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779606.964917:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525011584 00000100:00100000:1.0:1787779606.964921:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525011584 00000100:00100000:1.0:1787779606.964953:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1787779606.964960:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f6b4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874622525011584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779606.965010:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f6b4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874622525011584:12345-0@lo:400:kworker.0 Request processed in 50us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779606.965017:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1787779606.965055:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ab192c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874622525011584:0@lo:400:kworker.0 00000100:00100000:3.0:1787779606.976284:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842efb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+19:3304:x1874622525011456:12345-0@lo:400:kworker.0 Request processed in 12126us (12374us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779606.976300:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1787779606.977864:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ab1b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622525011840:0@lo:400:kworker.0 00000100:00100000:2.0:1787779606.977864:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ab18780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874622525012096:0@lo:400:kworker.0 00000100:00100000:1.0:1787779606.977953:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ab1a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874622525011712:0@lo:400:kworker.0 00000100:00100000:3.0:1787779606.978094:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779606.978200:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525011840 00000100:00100000:3.0:1787779606.978207:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525011840 00000100:00100000:3.0:1787779606.978266:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787779606.978453:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e851682d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622525011840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779606.978513:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e851682d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622525011840:12345-0@lo:400:kworker.0 Request processed in 239us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779606.978520:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787779606.978562:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ab1b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622525011840:0@lo:400:kworker.0 00000100:00100000:0.0:1787779606.980055:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ab19680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c28aae66-2825-42c5-8f52-61f687e868c9:3304:1874622525011456:0@lo:400:kworker.0 00000100:00100000:0.0:1787779606.980093:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ab1b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874622525011968:0@lo:400:kworker.0 00000100:00100000:0.0:1787779606.980156:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779606.983873:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525011968 00000100:00100000:2.0:1787779606.983875:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779606.983885:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525011968 00000100:00100000:3.0:1787779606.983947:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00080000:2.0:1787779606.983954:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787779606.983957:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87fd28b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874622525011968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779606.984060:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779606.984066:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87fd28b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874622525011968:12345-0@lo:400:kworker.0 Request processed in 112us (3910us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779606.984083:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787779606.984094:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525011712 00000100:00100000:1.0:1787779606.984097:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525011712 00000100:00080000:3.0:1787779606.984111:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787779606.984125:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787779606.984131:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f6b43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874622525011712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779606.984169:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f6b43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874622525011712:12345-0@lo:400:kworker.0 Request processed in 39us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779606.984192:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787779606.984234:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ab1a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874622525011712:0@lo:400:kworker.0 00000100:00100000:0.0:1787779606.985984:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525012096 00000100:00100000:0.0:1787779606.985997:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525012096 00000100:00100000:0.0:1787779606.986074:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787779606.986085:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ab18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874622525012096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779606.986163:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ab18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874622525012096:12345-0@lo:400:kworker.0 Request processed in 81us (2294us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779606.986170:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:3.0:1787779606.986252:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787779606.986388:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e87ab18780 x1874622525012096/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779622 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779606.986402:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ab18780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874622525012096:0@lo:400:kworker.0 00000100:00100000:2.0:1787779606.986443:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ab1b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874622525011968:0@lo:400:kworker.0 00010000:00010000:1.0:1787779607.158224:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779607.476213:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87fd2ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622525012224:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787779607.476316:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779607.476441:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525012224 00000100:00100000:0.0:1787779607.476449:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525012224 00000100:00100000:0.0:1787779607.476513:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787779607.476524:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f6b4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622525012224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787779607.476561:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787779607.476616:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f6b4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622525012224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779607.476623:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:0.0:1787779607.476680:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e87fd2ad00 x1874622525012224/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779623 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779607.476701:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87fd2ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622525012224:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787779608.179320:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779609.202984:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779609.254069:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779609.254123:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779609.254365:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505050624 00000100:00100000:3.0:1787779609.254376:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505050624 00000100:00100000:3.0:1787779609.254428:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 286 00000100:00100000:3.0:1787779609.254438:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842efa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+13:2358:x1874622505050624:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:3.0:1787779609.254511:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842efa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+13:2358:x1874622505050624:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 74us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779609.254519:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 286 00000100:00100000:2.0:1787779609.255397:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505050752 00000100:00100000:2.0:1787779609.255404:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505050752 00000100:00100000:2.0:1787779609.255466:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 128 00000100:00100000:2.0:1787779609.255484:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e855b3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+5:2358:x1874622505050752:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:2.0:1787779609.255541:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e855b3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+5:2358:x1874622505050752:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 59us (1418us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779609.255548:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 128 00000100:00080000:3.0:1787779609.255794:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787779609.280406:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779609.280463:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779609.280648:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505051008 00000100:00100000:2.0:1787779609.280660:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505051008 00000100:00100000:2.0:1787779609.280785:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 129 00000100:00080000:0.0:1787779609.280785:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787779609.280796:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e855b3f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54e1e60c-3037-4ae3-b045-838eb9e0ad0b+5:2357:x1874622505051008:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:2.0:1787779609.280888:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e855b3f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54e1e60c-3037-4ae3-b045-838eb9e0ad0b+5:2357:x1874622505051008:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 94us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779609.280897:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 129 00000100:00100000:3.0:1787779609.281126:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505050880 00000100:00100000:3.0:1787779609.281142:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505050880 00000100:00100000:3.0:1787779609.281276:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 19 00000100:00100000:3.0:1787779609.281285:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e855b3d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+5:2356:x1874622505050880:12345-192.168.201.9@tcp:9:kworker.0 00000020:00000080:3.0:1787779609.281308:0:6681:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9e63ba8af6889120 00000100:00080000:3.0:1787779609.281431:0:6681:0:(import.c:65:import_set_state_nolock()) ffff98e87a569800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787779609.281478:0:6681:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00010000:00010000:2.0:1787779609.281690:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779609.282067:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e855b3d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+2:2356:x1874622505050880:12345-192.168.201.9@tcp:9:kworker.0 Request processed in 778us (1669us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779609.282077:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 19 00000100:00080000:0.0:1787779609.282206:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787779610.227042:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779611.061977:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787779611.062004:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ab1b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622525012352:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787779611.062084:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779611.062280:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525012352 00000100:00100000:2.0:1787779611.062299:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525012352 00000100:00100000:2.0:1787779611.062366:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787779611.062377:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f538f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622525012352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787779611.062418:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787779611.062470:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f538f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622525012352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (385us total) trans 0 rc 0/0 00000100:00080000:1.0:1787779611.062619:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787779611.062684:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ab1b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622525012352:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787779611.062895:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00010000:0.0:1787779611.251256:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787779611.379505:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787779612.084071:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87a960000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c28aae66-2825-42c5-8f52-61f687e868c9:3304:1874622525012480:0@lo:400:kworker.0 00000100:00100000:2.0:1787779612.084167:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779612.084235:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87a963c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874622525012992:0@lo:400:kworker.0 00000100:00100000:2.0:1787779612.084264:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779612.084301:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787779612.084308:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87a962d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874622525012608:0@lo:400:kworker.0 00000100:00100000:2.0:1787779612.084331:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779612.084351:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87a960b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874622525013120:0@lo:400:kworker.0 00000100:00100000:2.0:1787779612.084375:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779612.084403:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525012992 00000100:00100000:2.0:1787779612.084410:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525012992 00000100:00100000:2.0:1787779612.084461:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525012608 00000100:00100000:2.0:1787779612.084464:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525012608 00000100:00100000:2.0:1787779612.084485:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1787779612.084495:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ab18780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874622525012992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779612.084544:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ab18780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874622525012992:12345-0@lo:400:kworker.0 Request processed in 50us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779612.084550:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1787779612.084566:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787779612.084572:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ab1ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874622525012608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779612.084597:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ab1ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874622525012608:12345-0@lo:400:kworker.0 Request processed in 25us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779612.084603:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:2.0:1787779612.084622:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787779612.084655:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87a962d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874622525012608:0@lo:400:kworker.0 00000100:00100000:2.0:1787779612.084667:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87a963c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874622525012992:0@lo:400:kworker.0 00000100:00100000:3.0:1787779612.085062:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87a961e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622525012864:0@lo:400:kworker.0 00000100:00100000:3.0:1787779612.085109:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779612.085143:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787779612.085150:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87a962580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874622525012736:0@lo:400:kworker.0 00000100:00100000:3.0:1787779612.085174:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779612.085199:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525012736 00000100:00100000:3.0:1787779612.085202:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525012736 00000100:00100000:3.0:1787779612.085246:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787779612.085253:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e8516812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874622525012736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779612.085289:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e8516812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874622525012736:12345-0@lo:400:kworker.0 Request processed in 37us (115us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779612.085295:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:3.0:1787779612.085312:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787779612.085329:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87a962580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874622525012736:0@lo:400:kworker.0 00000100:00100000:1.0:1787779612.085484:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525012480 00000100:00100000:1.0:1787779612.085489:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525012480 00000100:00100000:1.0:1787779612.085526:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1787779612.085533:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842efac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+19:3304:x1874622525012480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779612.085570:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842efac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+19:3304:x1874622525012480:12345-0@lo:400:kworker.0 Request processed in 38us (1403us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779612.085576:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1787779612.085685:0:10229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525013120 00000100:00100000:2.0:1787779612.085690:0:10229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525013120 00000100:00100000:2.0:1787779612.085766:0:10229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525012864 00000100:00100000:2.0:1787779612.085770:0:10229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525012864 00000100:00100000:2.0:1787779612.085788:0:10229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787779612.085807:0:10229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ab1a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874622525013120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779612.085841:0:10229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ab1a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874622525013120:12345-0@lo:400:kworker.0 Request processed in 36us (1465us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779612.085847:0:10229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787779612.085860:0:10229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787779612.085866:0:10229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e8516803c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622525012864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779612.085896:0:10229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e8516803c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622525012864:12345-0@lo:400:kworker.0 Request processed in 31us (787us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779612.085902:0:10229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:2.0:1787779612.085929:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e87a960b40 x1874622525013120/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779628 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779612.085940:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87a960b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874622525013120:0@lo:400:kworker.0 00000100:00100000:2.0:1787779612.085951:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87a960000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c28aae66-2825-42c5-8f52-61f687e868c9:3304:1874622525012480:0@lo:400:kworker.0 00000100:00080000:3.0:1787779612.086237:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787779612.086259:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87a961e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622525012864:0@lo:400:kworker.0 00010000:00010000:2.0:1787779612.275119:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779612.594900:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87fd2ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622525013248:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787779612.594973:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779612.595022:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525013248 00000100:00100000:0.0:1787779612.595030:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525013248 00000100:00100000:0.0:1787779612.595105:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787779612.595115:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a963480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622525013248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787779612.595162:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787779612.595214:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a963480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622525013248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779612.595222:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:1.0:1787779612.595353:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e87fd2ad00 x1874622525013248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779628 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779612.595373:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87fd2ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622525013248:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787779613.299807:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787779614.213590:0:6704:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e225400f-8d32-48a8-ab5e-fe4d3780a20c 00000020:00000080:0.0:1787779614.213600:0:6704:0:(genops.c:885:class_export_put()) final put ffff98e846b17800/e225400f-8d32-48a8-ab5e-fe4d3780a20c 00000020:00000080:1.0:1787779614.214579:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff98e846b17800/e225400f-8d32-48a8-ab5e-fe4d3780a20c for lustre-OST0000 00000020:00000080:1.0:1787779614.214644:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98e87a569800 for lustre-OST0000 00010000:00010000:0.0:1787779614.326137:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779614.384104:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779614.384179:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505051136 00000100:00100000:2.0:1787779614.384190:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505051136 00000100:00100000:2.0:1787779614.384256:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 288 00000100:00100000:2.0:1787779614.384267:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ef8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+13:2357:x1874622505051136:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:2.0:1787779614.384340:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ef8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+13:2357:x1874622505051136:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 76us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779614.384348:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 288 00000100:00100000:2.0:1787779614.392565:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779614.392849:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505051264 00000100:00100000:0.0:1787779614.392859:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505051264 00000100:00100000:0.0:1787779614.392933:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 133 00000100:00100000:0.0:1787779614.392944:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ab19e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+5:2357:x1874622505051264:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:0.0:1787779614.393030:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ab19e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+5:2357:x1874622505051264:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 89us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779614.393038:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 133 00000100:00080000:3.0:1787779614.393459:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787779614.404094:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779614.404253:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505051392 00000100:00100000:2.0:1787779614.404263:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505051392 00000100:00100000:2.0:1787779614.404363:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 134 00000100:00100000:2.0:1787779614.404374:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e8516821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54e1e60c-3037-4ae3-b045-838eb9e0ad0b+5:2358:x1874622505051392:12345-192.168.201.9@tcp:400:kworker.0 00000100:00080000:3.0:1787779614.404643:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787779614.405709:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e8516821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54e1e60c-3037-4ae3-b045-838eb9e0ad0b+5:2358:x1874622505051392:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 1331us (1618us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779614.405741:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 134 00010000:00010000:2.0:1787779615.348236:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779616.197735:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787779616.197765:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ab1bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622525013376:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787779616.197871:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779616.198078:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525013376 00000100:00100000:0.0:1787779616.198089:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525013376 00000100:00080000:2.0:1787779616.198180:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787779616.198194:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787779616.198205:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a961a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622525013376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787779616.198244:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787779616.198306:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a961a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622525013376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779616.198314:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787779616.202593:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ab1bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622525013376:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787779616.372065:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787779617.204089:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87fd2ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c28aae66-2825-42c5-8f52-61f687e868c9:3304:1874622525013504:0@lo:400:kworker.0 00000100:00100000:1.0:1787779617.204110:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ece7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874622525013760:0@lo:400:kworker.0 00000100:00100000:3.0:1787779617.204195:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ece6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874622525013632:0@lo:400:kworker.0 00000100:00100000:0.0:1787779617.210664:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ece43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622525013888:0@lo:400:kworker.0 00000100:00100000:1.0:1787779617.212435:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779617.212567:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525013760 00000100:00100000:1.0:1787779617.212578:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525013760 00000100:00100000:1.0:1787779617.212677:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787779617.212693:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a9621c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874622525013760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779617.212778:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a9621c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874622525013760:12345-0@lo:400:kworker.0 Request processed in 90us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779617.212786:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:1.0:1787779617.212814:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787779617.212847:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ece7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874622525013760:0@lo:400:kworker.0 00000100:00100000:2.0:1787779617.216184:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779617.216256:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e8521121c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874622525014016:0@lo:400:kworker.0 00000100:00100000:2.0:1787779617.216916:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779617.217165:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525014016 00000100:00100000:2.0:1787779617.217174:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525014016 00000100:00100000:2.0:1787779617.217240:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787779617.217250:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ab1bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874622525014016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779617.217844:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779617.217882:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e852111680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874622525014144:0@lo:400:kworker.0 00000100:00100000:2.0:1787779617.217901:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ab1bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874622525014016:12345-0@lo:400:kworker.0 Request processed in 652us (984us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779617.217910:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787779617.217915:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779617.217935:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525013632 00000100:00080000:3.0:1787779617.217975:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787779617.218035:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e8521121c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874622525014016:0@lo:400:kworker.0 00000100:00100000:3.0:1787779617.218072:0:10229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525014144 00000100:00100000:3.0:1787779617.218076:0:10229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525014144 00000100:00100000:1.0:1787779617.218078:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525013504 00000100:00100000:1.0:1787779617.218084:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525013504 00000100:00100000:3.0:1787779617.218119:0:10229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787779617.218119:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1787779617.218128:0:10229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e848f34780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874622525014144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779617.218128:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ef9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+19:3304:x1874622525013504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779617.218169:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ef9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+19:3304:x1874622525013504:12345-0@lo:400:kworker.0 Request processed in 42us (1995us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779617.218176:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1787779617.218180:0:10229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e848f34780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874622525014144:12345-0@lo:400:kworker.0 Request processed in 54us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779617.218185:0:10229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:3.0:1787779617.218199:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787779617.218211:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87fd2ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c28aae66-2825-42c5-8f52-61f687e868c9:3304:1874622525013504:0@lo:400:kworker.0 00010000:00080000:3.0:1787779617.218212:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e852111680 x1874622525014144/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779633 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779617.218223:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e852111680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874622525014144:0@lo:400:kworker.0 00000100:00100000:2.0:1787779617.219426:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525013632 00000100:00100000:2.0:1787779617.219488:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787779617.219498:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e851681e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874622525013632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779617.219570:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e851681e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874622525013632:12345-0@lo:400:kworker.0 Request processed in 74us (1727us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779617.219594:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787779617.220068:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ece6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874622525013632:0@lo:400:kworker.0 00000100:00100000:0.0:1787779617.231222:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779617.231407:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525013888 00000100:00100000:2.0:1787779617.231418:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525013888 00000100:00100000:2.0:1787779617.231531:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787779617.231543:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e852112940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622525013888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779617.231622:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e852112940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622525013888:12345-0@lo:400:kworker.0 Request processed in 82us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779617.231629:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787779617.231729:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ece43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622525013888:0@lo:400:kworker.0 00010000:00010000:0.0:1787779617.398240:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779617.715122:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e852110f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622525014272:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787779617.715194:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779617.715424:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525014272 00000100:00100000:0.0:1787779617.715433:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525014272 00000100:00100000:0.0:1787779617.715482:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787779617.715492:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a9603c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622525014272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787779617.715526:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787779617.715579:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a9603c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622525014272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779617.715586:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:3.0:1787779617.715660:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e852110f00 x1874622525014272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779633 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779617.715678:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e852110f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622525014272:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787779618.419010:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779619.449929:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779619.500472:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779619.500543:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779619.500572:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779619.500598:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505051776 00000100:00100000:3.0:1787779619.500606:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505051776 00000100:00100000:3.0:1787779619.500657:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505051648 00000100:00100000:3.0:1787779619.500660:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505051648 00000100:00100000:3.0:1787779619.500680:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 138 00000100:00100000:3.0:1787779619.500689:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e845d2d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54e1e60c-3037-4ae3-b045-838eb9e0ad0b+5:2358:x1874622505051776:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:3.0:1787779619.500792:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e845d2d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54e1e60c-3037-4ae3-b045-838eb9e0ad0b+5:2358:x1874622505051776:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 104us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779619.500799:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 138 00000100:00100000:3.0:1787779619.500814:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 139 00000100:00100000:3.0:1787779619.500819:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e845d2e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+5:2358:x1874622505051648:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:3.0:1787779619.500840:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e845d2e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+5:2358:x1874622505051648:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 21us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779619.500845:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 139 00000100:00080000:3.0:1787779619.500863:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787779619.501300:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505051520 00000100:00100000:0.0:1787779619.501306:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505051520 00000100:00100000:0.0:1787779619.501346:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 290 00000100:00100000:0.0:1787779619.501356:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842efbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+13:2358:x1874622505051520:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:0.0:1787779619.501398:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842efbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+13:2358:x1874622505051520:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 45us (935us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779619.501405:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 290 00010000:00010000:0.0:1787779620.467100:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779621.301019:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ab192c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622525014400:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787779621.301107:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779621.306905:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525014400 00000100:00100000:2.0:1787779621.306933:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525014400 00000100:00100000:2.0:1787779621.307054:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787779621.307065:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e845d2f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622525014400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787779621.307125:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1787779621.311074:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787779621.312931:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e845d2f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622525014400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5851us (11816us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779621.312947:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787779621.321081:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ab192c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622525014400:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787779621.491679:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787779621.620315:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:1.0:1787779621.963319:0:11844:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 17:26:59 (1787779619) 00000100:00100000:3.0:1787779622.323061:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e845d2ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622525014912:0@lo:400:kworker.0 00000100:00100000:2.0:1787779622.323120:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e845d2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874622525014784:0@lo:400:kworker.0 00000100:00100000:3.0:1787779622.323149:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779622.323203:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e845d2c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874622525014656:0@lo:400:kworker.0 00000100:00100000:1.0:1787779622.323261:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e845d2f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c28aae66-2825-42c5-8f52-61f687e868c9:3304:1874622525014528:0@lo:400:kworker.0 00000100:00100000:2.0:1787779622.338265:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779622.338552:0:10229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525014912 00000100:00100000:2.0:1787779622.338568:0:10229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525014912 00000100:00100000:2.0:1787779622.340077:0:10229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787779622.340105:0:10229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e845d2fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622525014912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779622.340249:0:10229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e845d2fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622525014912:12345-0@lo:400:kworker.0 Request processed in 159us (17100us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779622.340276:0:10229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787779622.340344:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525014784 00000100:00100000:2.0:1787779622.340353:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525014784 00000100:00100000:2.0:1787779622.340401:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787779622.340408:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ab183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874622525014784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779622.340455:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ab183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874622525014784:12345-0@lo:400:kworker.0 Request processed in 48us (2208us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779622.340463:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787779622.340548:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e845d2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874622525014784:0@lo:400:kworker.0 00000100:00080000:2.0:1787779622.340594:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787779622.345311:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779622.345424:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e845d2de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874622525015168:0@lo:400:kworker.0 00000100:00100000:0.0:1787779622.345493:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779622.345571:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525015168 00000100:00100000:0.0:1787779622.345582:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525015168 00000100:00100000:0.0:1787779622.345690:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787779622.345703:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e852110f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874622525015168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779622.345807:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e852110f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874622525015168:12345-0@lo:400:kworker.0 Request processed in 108us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779622.345815:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:0.0:1787779622.345850:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787779622.345890:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e845d2de00 x1874622525015168/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779638 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779622.347317:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e845d2de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874622525015168:0@lo:400:kworker.0 00000100:00100000:2.0:1787779622.347655:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525014656 00000100:00100000:2.0:1787779622.347665:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525014656 00000100:00100000:2.0:1787779622.347756:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787779622.347766:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e8521121c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874622525014656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779622.347877:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e8521121c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874622525014656:12345-0@lo:400:kworker.0 Request processed in 114us (2582us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779622.347886:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787779622.348395:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e845d2c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874622525014656:0@lo:400:kworker.0 00000100:00100000:1.0:1787779622.349073:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779622.349151:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e845d2e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874622525015040:0@lo:400:kworker.0 00000100:00100000:1.0:1787779622.349200:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779622.349235:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525015040 00000100:00100000:1.0:1787779622.349241:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525015040 00000100:00100000:1.0:1787779622.349305:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787779622.349314:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a960f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874622525015040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779622.349362:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a960f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874622525015040:12345-0@lo:400:kworker.0 Request processed in 50us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779622.349368:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787779622.349404:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e845d2e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874622525015040:0@lo:400:kworker.0 00000100:00100000:0.0:1787779622.349659:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525014528 00000100:00100000:0.0:1787779622.349664:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525014528 00000100:00100000:0.0:1787779622.349705:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1787779622.349745:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ebfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+19:3304:x1874622525014528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779622.349789:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ebfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+19:3304:x1874622525014528:12345-0@lo:400:kworker.0 Request processed in 77us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779622.349795:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00080000:0.0:1787779622.349824:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787779622.349917:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e845d2f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c28aae66-2825-42c5-8f52-61f687e868c9:3304:1874622525014528:0@lo:400:kworker.0 00000100:00100000:3.0:1787779622.352692:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e845d2ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622525014912:0@lo:400:kworker.0 00010000:00010000:2.0:1787779622.520028:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779622.837992:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787779622.838027:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e852111680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622525015296:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787779622.838152:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779622.838378:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525015296 00000100:00100000:1.0:1787779622.838387:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525015296 00000100:00100000:1.0:1787779622.838528:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787779622.838538:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e845d2ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622525015296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787779622.838587:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787779622.838645:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e845d2ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622525015296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779622.838652:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:3.0:1787779622.838810:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e852111680 x1874622525015296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779638 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779622.838830:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e852111680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622525015296:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787779623.539182:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779623.876144:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779623.876457:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505051904 00000100:00100000:2.0:1787779623.876467:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505051904 00000100:00100000:2.0:1787779623.876551:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 32 00000100:00100000:2.0:1787779623.876564:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e845d2cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+5:10249:x1874622505051904:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787779623.876588:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779623.876614:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66400/0x9e63ba8af68891eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedac41 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779623.876788:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af68891f2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779623.876803:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af68891f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779623.876817:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af68891f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787779623.877040:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787779623.877046:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787779623.877156:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af68891f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779623.877184:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66400/0x9e63ba8af68891eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac41 expref: 7 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779623.877219:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af68891f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac41 expref: 6 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779623.877228:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e84927f500) 00010000:00010000:2.0:1787779623.877241:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787779623.877245:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87aa66200, rc 0) 00000100:00100000:2.0:1787779623.877314:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e845d2cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:10249:x1874622505051904:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 Request processed in 754us (1181us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779623.877322:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 32 00000100:00080000:0.0:1787779623.878002:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787779623.884824:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779623.884920:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505052032 00000100:00100000:1.0:1787779623.884944:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505052032 00000100:00100000:1.0:1787779623.885010:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 33 00000100:00100000:1.0:1787779623.885023:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e852111680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:10250:x1874622505052032:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787779623.885048:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779623.885073:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b800/0x9e63ba8af68891f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedac48 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779623.885146:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af6889200 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779623.885178:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af6889200 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779623.885189:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af6889200 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779623.885220:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889207 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779623.885227:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889207 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779623.885247:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889207 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779623.885694:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a000/0x9e63ba8af688920e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779623.885705:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a000/0x9e63ba8af688920e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779623.885748:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a000/0x9e63ba8af688920e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787779623.885834:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1787779623.885837:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787779623.885910:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a000/0x9e63ba8af688920e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779623.885920:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af6889200 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779623.885936:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af6889200 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779623.885942:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af6889200 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779623.885949:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87a98a600 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:1.0:1787779623.885953:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af6889200 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779623.885961:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af6889200 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779623.885976:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e84927f500) 00010000:00010000:1.0:1787779623.885980:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787779623.885985:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af6889200 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779623.885992:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af6889200 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779623.886006:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889207 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779623.886011:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889207 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779623.886015:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889207 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779623.886018:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87a98ae00 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:1.0:1787779623.886025:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889207 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779623.886029:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889207 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779623.886034:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff98e860c40800) 00010000:00010000:1.0:1787779623.886036:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787779623.886038:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889207 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779623.886041:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889207 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779623.886066:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b800/0x9e63ba8af68891f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac48 expref: 8 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779623.886075:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a000/0x9e63ba8af688920e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac48 expref: 7 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779623.886079:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98e860c40200) 00010000:00010000:1.0:1787779623.886081:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787779623.886083:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87a98a000, rc 0) 00000100:00100000:1.0:1787779623.886142:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e852111680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+7:10250:x1874622505052032:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 Request processed in 1124us (1330us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779623.886147:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 33 00000100:00100000:3.0:1787779623.892520:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779623.892656:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505052288 00000100:00100000:2.0:1787779623.892666:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505052288 00000100:00100000:2.0:1787779623.892771:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 34 00000100:00100000:2.0:1787779623.892781:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e845d2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+7:10250:x1874622505052288:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787779623.892803:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779623.892831:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66400/0x9e63ba8af6889215 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedac4f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779623.892920:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af688921c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779623.892941:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af688921c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779623.892952:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af688921c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779623.892985:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67600/0x9e63ba8af6889223 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779623.892992:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67600/0x9e63ba8af6889223 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779623.892998:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67600/0x9e63ba8af6889223 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779623.893467:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67800/0x9e63ba8af688922a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779623.893474:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67800/0x9e63ba8af688922a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779623.893479:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67800/0x9e63ba8af688922a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787779623.893492:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1787779623.893640:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af688921c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779623.893647:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af688921c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779623.893653:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af688921c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779623.893660:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87aa66e00 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:2.0:1787779623.893663:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af688921c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779623.893670:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af688921c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779623.893682:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98e860c40200) 00010000:00010000:2.0:1787779623.893685:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787779623.893690:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af688921c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779623.893696:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af688921c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779623.893707:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67600/0x9e63ba8af6889223 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779623.893832:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67600/0x9e63ba8af6889223 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779623.893843:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67600/0x9e63ba8af6889223 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779623.893847:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87aa67600 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:2.0:1787779623.893848:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67600/0x9e63ba8af6889223 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779623.893852:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67600/0x9e63ba8af6889223 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779623.893858:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff98e84927f300) 00010000:00010000:2.0:1787779623.893859:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787779623.893862:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67600/0x9e63ba8af6889223 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779623.893865:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67600/0x9e63ba8af6889223 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779623.894216:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66400/0x9e63ba8af6889215 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac4f expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779623.894225:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67800/0x9e63ba8af688922a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac4f expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779623.894525:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98e84927fc00) 00010000:00010000:2.0:1787779623.894528:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787779623.894531:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87aa67800, rc 0) 00000100:00100000:2.0:1787779623.894593:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e845d2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+9:10250:x1874622505052288:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 Request processed in 1815us (2082us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1787779623.894607:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 34 00000100:00100000:2.0:1787779623.901826:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779623.901892:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505052416 00000100:00100000:1.0:1787779623.901903:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505052416 00000100:00100000:1.0:1787779623.902016:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 35 00000100:00100000:1.0:1787779623.902027:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ab1a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+9:10250:x1874622505052416:12345-192.168.201.9@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1787779623.902149:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ab1a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+9:10250:x1874622505052416:12345-192.168.201.9@tcp:59:lhsmtool_posix.0 Request processed in 123us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779623.902156:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 35 00000001:00080000:2.0:1787779624.441159:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00010000:00010000:0.0:1787779624.575679:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779624.609139:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779624.609197:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779624.609221:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779624.612972:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505052672 00000100:00100000:2.0:1787779624.612992:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505052672 00000100:00100000:2.0:1787779624.613077:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505052800 00000100:00100000:2.0:1787779624.613081:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505052800 00000100:00100000:2.0:1787779624.613124:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 143 00000100:00100000:2.0:1787779624.613134:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842fed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+8:2360:x1874622505052672:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:2.0:1787779624.613228:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842fed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+8:2360:x1874622505052672:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 95us (4102us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779624.613236:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 143 00000100:00100000:2.0:1787779624.613255:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 144 00000100:00100000:2.0:1787779624.613261:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842fef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54e1e60c-3037-4ae3-b045-838eb9e0ad0b+5:2360:x1874622505052800:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:2.0:1787779624.613286:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842fef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54e1e60c-3037-4ae3-b045-838eb9e0ad0b+5:2360:x1874622505052800:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 26us (4064us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779624.613293:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 144 00000100:00080000:2.0:1787779624.613312:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787779624.620090:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505052544 00000100:00100000:3.0:1787779624.620106:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505052544 00000100:00100000:3.0:1787779624.620235:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 292 00000100:00100000:3.0:1787779624.620244:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ebcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+13:2360:x1874622505052544:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:3.0:1787779624.620332:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ebcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+13:2360:x1874622505052544:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 88us (11133us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779624.620340:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 292 00000040:00080000:1.0:1787779624.692918:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787779625.596305:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787779626.423250:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787779626.423274:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ab18b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622525015424:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787779626.423348:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779626.427478:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525015424 00000100:00100000:0.0:1787779626.427519:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525015424 00000100:00100000:0.0:1787779626.427599:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787779626.427610:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ab1b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622525015424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787779626.427654:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787779626.427807:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ab1b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622525015424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 199us (4458us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779626.427815:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:0.0:1787779626.427861:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787779626.427907:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ab18b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622525015424:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787779626.612766:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779626.630339:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779626.630418:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505052928 00000100:00100000:1.0:1787779626.630428:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505052928 00000100:00100000:1.0:1787779626.630503:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 36 00000100:00100000:1.0:1787779626.630513:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e845d2da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+8:10292:x1874622505052928:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:1.0:1787779626.630533:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779626.630555:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98be00/0x9e63ba8af6889238 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedac56 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779626.630618:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af688923f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779626.630633:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af688923f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779626.630644:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af688923f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779626.630658:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af6889246 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779626.630665:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af6889246 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779626.630671:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af6889246 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787779626.630911:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787779626.631154:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af688923f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779626.631163:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af688923f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779626.631170:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af688923f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779626.631177:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87a98aa00 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:1.0:1787779626.631181:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af688923f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779626.631189:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af688923f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779626.631202:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e84927f500) 00010000:00010000:1.0:1787779626.631205:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787779626.631209:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af688923f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779626.631216:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af688923f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779626.631227:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af6889246 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779626.631234:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af6889246 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779626.631240:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af6889246 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779626.631252:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87a98b600 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:1.0:1787779626.631255:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af6889246 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779626.631262:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af6889246 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779626.631270:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff98e860c40500) 00010000:00010000:1.0:1787779626.631272:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787779626.631275:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af6889246 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779626.631282:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af6889246 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779626.631312:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98be00/0x9e63ba8af6889238 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac56 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779626.631322:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e84927f500) 00010000:00010000:1.0:1787779626.631324:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787779626.631328:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98be00/0x9e63ba8af6889238 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac56 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779626.631337:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87a98be00, rc 0) 00000100:00100000:1.0:1787779626.631401:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e845d2da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+8:10292:x1874622505052928:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 889us (1071us total) trans 0 rc 301/301 00000100:00100000:1.0:1787779626.631409:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 36 00000100:00100000:3.0:1787779626.648180:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779626.648314:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505053184 00000100:00100000:1.0:1787779626.648334:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505053184 00000100:00100000:1.0:1787779626.648392:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 37 00000100:00100000:1.0:1787779626.648401:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e845d2e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+8:10292:x1874622505053184:12345-192.168.201.9@tcp:36:lfs.0 00010000:00010000:1.0:1787779626.648457:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787779626.648484:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af68891f2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac41 expref: 8 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779626.648503:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e84927f500) 00010000:00010000:1.0:1787779626.648524:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787779626.648852:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af688924d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779626.648867:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af688924d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779626.648877:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af688924d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779626.648891:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98bc00/0x9e63ba8af6889254 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779626.648898:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98bc00/0x9e63ba8af6889254 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779626.648904:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98bc00/0x9e63ba8af6889254 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787779626.650761:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1787779626.653582:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af688924d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779626.653601:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af688924d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779626.653619:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af688924d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779626.653625:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87a98a400 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:1.0:1787779626.653631:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af688924d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779626.653639:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af688924d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779626.653656:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e860c40100) 00010000:00010000:1.0:1787779626.653659:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787779626.653664:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af688924d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779626.653671:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af688924d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787779626.653706:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f9b90fdc reply state 0000000072cc2bcf transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98bc00/0x9e63ba8af6889254 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779626.654512:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787779626.654730:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e845d2e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+9:10292:x1874622505053184:12345-192.168.201.9@tcp:36:lfs.0 Request processed in 6307us (6537us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1787779626.654740:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 37 00010000:00010000:3.0:1787779626.675116:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98bc00/0x9e63ba8af6889254 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779626.675131:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98bc00/0x9e63ba8af6889254 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779626.675139:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98bc00/0x9e63ba8af6889254 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779626.675144:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87a98bc00 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:3.0:1787779626.675149:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98bc00/0x9e63ba8af6889254 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779626.675173:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98bc00/0x9e63ba8af6889254 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779626.675191:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff98e860c40d00) 00010000:00010000:3.0:1787779626.675194:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779626.675199:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98bc00/0x9e63ba8af6889254 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779626.675205:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98bc00/0x9e63ba8af6889254 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779626.861353:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779626.861751:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505053312 00000100:00100000:1.0:1787779626.861763:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505053312 00000100:00100000:1.0:1787779626.861840:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 38 00000100:00100000:1.0:1787779626.861850:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e845d2c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+8:10300:x1874622505053312:12345-192.168.201.9@tcp:101:lctl.0 00010000:00010000:1.0:1787779626.861891:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779626.861917:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af688925b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedac5d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779626.863093:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98be00/0x9e63ba8af6889262 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779626.863116:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98be00/0x9e63ba8af6889262 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779626.863131:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98be00/0x9e63ba8af6889262 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787779626.863215:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787779626.863220:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787779626.863281:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98be00/0x9e63ba8af6889262 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779626.863312:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af688925b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac5d expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779626.863336:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98be00/0x9e63ba8af6889262 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac5d expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779626.863344:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e860c40100) 00010000:00010000:1.0:1787779626.863347:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787779626.863350:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87a98be00, rc 0) 00000100:00100000:1.0:1787779626.863670:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e845d2c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+9:10300:x1874622505053312:12345-192.168.201.9@tcp:101:lctl.0 Request processed in 1819us (2328us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779626.863678:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 38 00000100:00100000:2.0:1787779626.942815:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779626.944317:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505053440 00000100:00100000:3.0:1787779626.944330:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505053440 00000100:00100000:3.0:1787779626.944399:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 39 00000100:00100000:3.0:1787779626.944410:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ab18f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+9:10305:x1874622505053440:12345-192.168.201.9@tcp:101:bash.0 00010000:00010000:3.0:1787779626.944430:0:8197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779626.944451:0:8197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5200/0x9e63ba8af6889269 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedac64 expref: -99 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779626.944522:0:8197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af6889270 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779626.944537:0:8197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af6889270 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779626.944548:0:8197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af6889270 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779626.944562:0:8197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af6889277 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779626.944583:0:8197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af6889277 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779626.944591:0:8197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af6889277 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779626.944698:0:8197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5600/0x9e63ba8af688927e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779626.944706:0:8197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5600/0x9e63ba8af688927e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779626.944741:0:8197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5600/0x9e63ba8af688927e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787779626.944777:0:8197:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:3.0:1787779626.944781:0:8197:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787779626.944834:0:8197:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5600/0x9e63ba8af688927e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779626.944847:0:8197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af6889270 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779626.944854:0:8197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af6889270 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779626.944860:0:8197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af6889270 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779626.944866:0:8197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e8429d4e00 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:3.0:1787779626.944870:0:8197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af6889270 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779626.944884:0:8197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af6889270 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779626.944897:0:8197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e860c40100) 00010000:00010000:3.0:1787779626.944900:0:8197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779626.944905:0:8197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af6889270 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779626.944911:0:8197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af6889270 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779626.944926:0:8197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af6889277 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779626.944932:0:8197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af6889277 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779626.944938:0:8197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af6889277 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779626.944944:0:8197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e8429d4400 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:3.0:1787779626.944946:0:8197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af6889277 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779626.944952:0:8197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af6889277 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779626.944959:0:8197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff98e87450a100) 00010000:00010000:3.0:1787779626.944961:0:8197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779626.944964:0:8197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af6889277 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779626.944980:0:8197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af6889277 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779626.945015:0:8197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5200/0x9e63ba8af6889269 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac64 expref: 11 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779626.945029:0:8197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5600/0x9e63ba8af688927e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac64 expref: 10 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779626.945037:0:8197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98e87450a200) 00010000:00010000:3.0:1787779626.945039:0:8197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787779626.945041:0:8197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e8429d5600, rc 0) 00000100:00100000:3.0:1787779626.945403:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ab18f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+10:10305:x1874622505053440:12345-192.168.201.9@tcp:101:bash.0 Request processed in 993us (2596us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779626.945412:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 39 00000100:00100000:0.0:1787779626.963200:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779626.963929:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505053696 00000100:00100000:2.0:1787779626.963941:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505053696 00000100:00100000:2.0:1787779626.964008:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 40 00000100:00100000:2.0:1787779626.964018:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842fede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+10:10305:x1874622505053696:12345-192.168.201.9@tcp:101:bash.0 00010000:00010000:2.0:1787779626.964053:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779626.964075:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67200/0x9e63ba8af6889285 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedac6b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779626.964210:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66000/0x9e63ba8af688928c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779626.964225:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66000/0x9e63ba8af688928c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779626.964236:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66000/0x9e63ba8af688928c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779626.964295:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af6889293 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779626.964303:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af6889293 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779626.964310:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af6889293 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787779626.966636:0:5837:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:2.0:1787779626.967555:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67600/0x9e63ba8af688929a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779626.967596:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67600/0x9e63ba8af688929a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779626.967610:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67600/0x9e63ba8af688929a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779626.967667:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66000/0x9e63ba8af688928c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779626.967675:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66000/0x9e63ba8af688928c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779626.967681:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66000/0x9e63ba8af688928c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779626.967687:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87aa66000 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:2.0:1787779626.967691:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66000/0x9e63ba8af688928c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779626.967699:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66000/0x9e63ba8af688928c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779626.967799:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98e87450a200) 00010000:00010000:2.0:1787779626.967803:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787779626.967808:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66000/0x9e63ba8af688928c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779626.967886:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66000/0x9e63ba8af688928c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787779626.967903:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a4ce81ff reply state 0000000096c62a3b transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af6889293 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779626.967912:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787779626.967950:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67200/0x9e63ba8af6889285 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac6b expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779626.967978:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67600/0x9e63ba8af688929a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac6b expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779626.967985:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e84927fd00) 00010000:00010000:2.0:1787779626.967987:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787779626.967989:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87aa67600, rc 0) 00000100:00100000:2.0:1787779626.968111:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842fede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+13:10305:x1874622505053696:12345-192.168.201.9@tcp:101:bash.0 Request processed in 4094us (4920us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1787779626.968121:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 40 00010000:00010000:3.0:1787779626.976420:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af6889293 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779626.976438:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af6889293 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779626.976516:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af6889293 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779626.976523:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87aa66e00 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:3.0:1787779626.976529:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af6889293 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779626.976537:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af6889293 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779626.976568:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98e84927fa00) 00010000:00010000:3.0:1787779626.976571:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779626.976577:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af6889293 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779626.976582:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af6889293 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779626.986841:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779626.987018:0:10229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505053824 00000100:00100000:2.0:1787779626.987029:0:10229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505053824 00000100:00100000:2.0:1787779626.987078:0:10229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 20 00000100:00100000:2.0:1787779626.987086:0:10229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842fecb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2356:x1874622505053824:12345-192.168.201.9@tcp:8:bash.0 00010000:00080000:2.0:1787779626.987121:0:10229:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from e225400f-8d32-48a8-ab5e-fe4d3780a20c@192.168.201.9@tcp t0 exp 0000000000000000 cur 392 last 0 00000020:00000080:2.0:1787779626.987159:0:10229:0:(genops.c:1385:class_connect()) connect: client e225400f-8d32-48a8-ab5e-fe4d3780a20c, cookie 0x9e63ba8af68892a8 00002000:00100000:2.0:1787779626.987173:0:10229:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e225400f-8d32-48a8-ab5e-fe4d3780a20c/ffff98e881da1800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113939 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787779626.987198:0:10229:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787779626.987416:0:10229:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787779626.987574:0:10229:0:(import.c:65:import_set_state_nolock()) ffff98e881da1000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787779626.987641:0:10229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842fecb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:2356:x1874622505053824:12345-192.168.201.9@tcp:8:bash.0 Request processed in 553us (827us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779626.987650:0:10229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 20 00000100:00100000:0.0:1787779627.004087:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779627.004221:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505053952 00000100:00100000:3.0:1787779627.004230:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505053952 00000100:00100000:3.0:1787779627.004305:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 21 00000100:00100000:3.0:1787779627.004315:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842fec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:0:x1874622505053952:12345-192.168.201.9@tcp:101:bash.0 00010000:00010000:3.0:1787779627.004334:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779627.004356:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a99c53bd/0x9e63ba8af68892af lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedac72 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787779627.004381:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787779627.004397:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=392s v=(0 0) 00010000:00010000:3.0:1787779627.004402:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787779627.004411:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a99c53bd/0x9e63ba8af68892af lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac72 expref: 7 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779627.004431:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a99c53bd/0x9e63ba8af68892af lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac72 expref: 7 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779627.004457:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e8429d5200, rc 0) 00000100:00100000:3.0:1787779627.004517:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842fec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+7:0:x1874622505053952:12345-192.168.201.9@tcp:101:bash.0 Request processed in 204us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779627.004537:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 21 00000100:00080000:0.0:1787779627.007762:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787779627.008225:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779627.009709:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505054080 00000100:00100000:1.0:1787779627.009735:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505054080 00000100:00100000:2.0:1787779627.009963:0:10229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 22 00000100:00100000:2.0:1787779627.009988:0:10229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e845d2cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+7:10305:x1874622505054080:12345-192.168.201.9@tcp:101:bash.0 00010000:00010000:2.0:1787779627.010035:0:10229:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779627.010064:0:10229:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000035afe464/0x9e63ba8af68892b6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedac79 expref: -99 pid: 10229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779627.010102:0:10229:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a99c53bd/0x9e63ba8af68892af lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac72 expref: 8 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779627.010112:0:10229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787779627.010117:0:10229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787779627.010124:0:10229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035afe464/0x9e63ba8af68892b6 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac79 expref: 8 pid: 10229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779627.010166:0:10229:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a99c53bd/0x9e63ba8af68892af lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac72 expref: 8 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779627.010182:0:10229:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a99c53bd/0x9e63ba8af68892af lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac72 expref: 8 pid: 6681 timeout: 492 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779627.010197:0:10229:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ab192c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10229:1874622525015552:192.168.201.9@tcp:104: 00000100:00100000:2.0:1787779627.010317:0:10229:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e8521e0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787779627.013772:0:10229:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ab192c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10229:1874622525015552:192.168.201.9@tcp:104: 00010000:00010000:2.0:1787779627.013843:0:10229:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000035afe464/0x9e63ba8af68892b6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac79 expref: 8 pid: 10229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779627.013869:0:10229:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87aa67200, rc 0) 00000100:00100000:2.0:1787779627.013950:0:10229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e845d2cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+8:10305:x1874622505054080:12345-192.168.201.9@tcp:101:bash.0 Request processed in 3976us (5732us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779627.013959:0:10229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 22 00000100:00100000:0.0:1787779627.020131:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779627.020805:0:11162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505054208 00000100:00100000:2.0:1787779627.020815:0:11162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505054208 00010000:00010000:2.0:1787779627.020873:0:11162:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a99c53bd/0x9e63ba8af68892af lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac72 expref: 8 pid: 6681 timeout: 492 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779627.020924:0:11162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 35 00000100:00100000:2.0:1787779627.020934:0:11162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842feda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+8:2360:x1874622505054208:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787779627.020951:0:11162:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787779627.020976:0:11162:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a99c53bd/0x9e63ba8af68892af lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac72 expref: 8 pid: 6681 timeout: 492 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779627.020991:0:11162:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a99c53bd/0x9e63ba8af68892af lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac72 expref: 8 pid: 6681 timeout: 492 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779627.021018:0:11162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a99c53bd/0x9e63ba8af68892af lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac72 expref: 8 pid: 6681 timeout: 492 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779627.021036:0:11162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787779627.021040:0:11162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787779627.021045:0:11162:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000035afe464/0x9e63ba8af68892b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac79 expref: 7 pid: 10229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779627.021053:0:11162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035afe464/0x9e63ba8af68892b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac79 expref: 7 pid: 10229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779627.021095:0:11162:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000035afe464/0x9e63ba8af68892b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac79 expref: 7 pid: 10229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779627.021106:0:11162:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ab192c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11162:1874622525015680:192.168.201.9@tcp:105: 00000100:00100000:2.0:1787779627.021180:0:11162:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e8521e0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787779627.033283:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779627.033386:0:11162:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ab192c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11162:1874622525015680:192.168.201.9@tcp:105: 00010000:00010000:0.0:1787779627.033412:0:11162:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787779627.033472:0:11162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842feda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+7:2360:x1874622505054208:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 12539us (13350us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779627.033484:0:11162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 35 00000100:00100000:1.0:1787779627.035799:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505054464 00000100:00100000:1.0:1787779627.035821:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505054464 00000100:00100000:1.0:1787779627.035897:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 6 00000100:00100000:1.0:1787779627.035907:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ab19680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+12:10305:x1874622505054464:12345-192.168.201.9@tcp:35:bash.0 00000100:00100000:1.0:1787779627.036256:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ab19680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+13:10305:x1874622505054464:12345-192.168.201.9@tcp:35:bash.0 Request processed in 350us (2981us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1787779627.036265:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 6 00000100:00100000:2.0:1787779627.189877:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779627.190021:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505054720 00000100:00100000:1.0:1787779627.190032:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505054720 00000100:00100000:1.0:1787779627.190108:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 41 00000100:00100000:1.0:1787779627.190119:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ab1a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+13:10316:x1874622505054720:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:1.0:1787779627.190146:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779627.190168:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af68892bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedac80 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787779627.190280:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1787779627.190375:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af68892bd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac80 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779627.190386:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e860c40100) 00010000:00010000:1.0:1787779627.190388:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787779627.190392:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af68892bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac80 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779627.190402:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87a98aa00, rc 0) 00000100:00100000:1.0:1787779627.190449:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ab1a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+14:10316:x1874622505054720:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 333us (581us total) trans 4294967313 rc 301/301 00000100:00100000:1.0:1787779627.190470:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 41 00000100:00100000:0.0:1787779627.197120:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779627.197196:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505054976 00000100:00100000:1.0:1787779627.197204:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505054976 00000100:00100000:1.0:1787779627.197263:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 7 00000100:00100000:1.0:1787779627.197273:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842fef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+14:10316:x1874622505054976:12345-192.168.201.9@tcp:35:lfs.0 00000100:00100000:1.0:1787779627.197523:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842fef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+15:10316:x1874622505054976:12345-192.168.201.9@tcp:35:lfs.0 Request processed in 250us (411us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1787779627.197531:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 7 00000100:00100000:3.0:1787779627.331661:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779627.331999:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505055104 00000100:00100000:1.0:1787779627.332008:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505055104 00000100:00100000:1.0:1787779627.332079:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 42 00000100:00100000:1.0:1787779627.332091:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e845d2d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+15:10322:x1874622505055104:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:1.0:1787779627.332117:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779627.332137:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af68892cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedac87 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779627.332214:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af68892d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779627.332228:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af68892d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779627.332241:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af68892d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787779627.332308:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:1.0:1787779627.332312:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787779627.332355:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af68892d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779627.332381:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af68892cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac87 expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779627.332401:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af68892d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac87 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779627.332409:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98e87450a200) 00010000:00010000:1.0:1787779627.332412:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787779627.332416:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87a98a600, rc 0) 00000100:00100000:1.0:1787779627.332494:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e845d2d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+16:10322:x1874622505055104:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 406us (843us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779627.332502:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 42 00000100:00100000:3.0:1787779627.339272:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779627.339551:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505055360 00000100:00100000:1.0:1787779627.339562:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505055360 00000100:00100000:1.0:1787779627.339667:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 43 00000100:00100000:1.0:1787779627.339678:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e845d2f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+16:10322:x1874622505055360:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:1.0:1787779627.339708:0:8197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779627.339752:0:8197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af68892d9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedac8e expref: -99 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779627.339879:0:8197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af68892e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779627.339893:0:8197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af68892e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779627.339904:0:8197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af68892e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787779627.339932:0:8197:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787779627.340090:0:8197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af68892d9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac8e expref: 19 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779627.340109:0:8197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af68892e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac8e expref: 18 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779627.340118:0:8197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e84927fd00) 00010000:00010000:1.0:1787779627.340120:0:8197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787779627.340124:0:8197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87a98ae00, rc 0) 00000100:00100000:1.0:1787779627.340202:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e845d2f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+18:10322:x1874622505055360:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 526us (940us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1787779627.340211:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 43 00000100:00100000:2.0:1787779627.347319:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779627.347363:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779627.347391:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505055744 00000100:00100000:2.0:1787779627.347400:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505055744 00000100:00100000:2.0:1787779627.347471:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 2 00000100:00100000:2.0:1787779627.347481:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ab19a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+18:2358:x1874622505055744:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787779627.347497:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787779627.347525:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af68892e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac8e expref: 18 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779627.347547:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e84927fd00) 00010000:00010000:2.0:1787779627.347553:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787779627.347604:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ab19a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+17:2358:x1874622505055744:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 124us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779627.347611:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 2 00000100:00100000:3.0:1787779627.349137:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505055616 00000100:00100000:3.0:1787779627.349147:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505055616 00000100:00100000:3.0:1787779627.349195:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 44 00000100:00100000:3.0:1787779627.349204:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ab192c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+17:10322:x1874622505055616:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:3.0:1787779627.349225:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779627.349243:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af68892ee lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedac95 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779627.349336:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af68892f5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779627.349350:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af68892f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779627.349361:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af68892f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787779627.349374:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787779627.349512:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af68892ee lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac95 expref: 20 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779627.349532:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af68892f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac95 expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779627.349559:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e84927fd00) 00010000:00010000:3.0:1787779627.349562:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787779627.349565:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e8429d4e00, rc 0) 00000100:00100000:3.0:1787779627.349618:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ab192c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+19:10322:x1874622505055616:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 415us (2309us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1787779627.349624:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 44 00000100:00100000:2.0:1787779627.366561:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779627.367080:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505055872 00000100:00100000:3.0:1787779627.367090:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505055872 00000100:00100000:3.0:1787779627.367187:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 23 00000100:00100000:3.0:1787779627.367199:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ab18b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+7:2358:x1874622505055872:12345-192.168.201.9@tcp:1:lfs.0 00010000:00010000:3.0:1787779627.367244:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f874b20/0x9e63ba8af6889303 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779627.367265:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000035afe464/0x9e63ba8af68892b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac79 expref: 7 pid: 10229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779627.367275:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787779627.367279:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787779627.367283:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f874b20/0x9e63ba8af6889303 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779627.367319:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000035afe464/0x9e63ba8af68892b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac79 expref: 7 pid: 10229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779627.367335:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000035afe464/0x9e63ba8af68892b6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac79 expref: 7 pid: 10229 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779627.367366:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e845d2e580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1874622525015808:192.168.201.9@tcp:104: 00000100:00100000:3.0:1787779627.367484:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e87eb42e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787779627.371345:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779627.371460:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505056000 00000100:00100000:1.0:1787779627.371468:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505056000 00002000:00100000:1.0:1787779627.371514:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff98e845d2c780 x1874622505056000/t0(0) o4->e225400f-8d32-48a8-ab5e-fe4d3780a20c@192.168.201.9@tcp:38/0 lens 504/0 e 0 to 0 dl 1787779638 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787779627.371525:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98e845d2c780 with x1874622505056000 ext(0->12) 00010000:00010000:1.0:1787779627.371534:0:6685:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000035afe464/0x9e63ba8af68892b6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac79 expref: 8 pid: 10229 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779627.371550:0:6685:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000035afe464/0x9e63ba8af68892b6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac79 expref: 8 pid: 10229 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787779627.371559:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff98e845d2c780 00000100:00100000:1.0:1787779627.371594:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 0 00000100:00100000:1.0:1787779627.371618:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e845d2c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+8:2360:x1874622505056000:12345-192.168.201.9@tcp:4:lfs.0 00000100:00100000:0.0:1787779627.372519:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e845d2e580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1874622525015808:192.168.201.9@tcp:104: 00010000:00010000:0.0:1787779627.372548:0:6681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002f874b20/0x9e63ba8af6889303 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:2.0:1787779627.427123:0:7634:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e225400f-8d32-48a8-ab5e-fe4d3780a20c 00000100:00100000:1.0:1787779627.433108:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e845d2c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+9:2360:x1874622505056000:12345-192.168.201.9@tcp:4:lfs.0 Request processed in 61483us (61763us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1787779627.433123:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 0 00002000:00100000:1.0:1787779627.433136:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff98e845d2c780 x1874622505056000/t4294967299(0) o4->e225400f-8d32-48a8-ab5e-fe4d3780a20c@192.168.201.9@tcp:38/0 lens 504/448 e 0 to 0 dl 1787779638 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787779627.433146:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98e845d2c780 with x1874622505056000 ext(0->12) 00010000:00010000:1.0:1787779627.433158:0:6685:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000035afe464/0x9e63ba8af68892b6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac79 expref: 9 pid: 10229 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779627.433177:0:6685:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000035afe464/0x9e63ba8af68892b6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac79 expref: 9 pid: 10229 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787779627.433185:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff98e845d2c780 00000100:00100000:2.0:1787779627.441007:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779627.441196:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505056128 00000100:00100000:3.0:1787779627.441206:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505056128 00010000:00010000:3.0:1787779627.441246:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000035afe464/0x9e63ba8af68892b6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac79 expref: 9 pid: 10229 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779627.441290:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 36 00000100:00100000:3.0:1787779627.441301:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e874221680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+9:2359:x1874622505056128:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787779627.441315:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787779627.441333:0:5822:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1787779627.441336:0:5822:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1787779626 00002000:00010000:3.0:1787779627.441339:0:5822:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1787779626 00002000:00010000:3.0:1787779627.441341:0:5822:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1787779626 00010000:00010000:3.0:1787779627.441347:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000035afe464/0x9e63ba8af68892b6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac79 expref: 9 pid: 10229 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779627.441363:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000035afe464/0x9e63ba8af68892b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac79 expref: 9 pid: 10229 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779627.441389:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035afe464/0x9e63ba8af68892b6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac79 expref: 9 pid: 10229 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779627.441420:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787779627.441424:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787779627.441430:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002f874b20/0x9e63ba8af6889303 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779627.441452:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f874b20/0x9e63ba8af6889303 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779627.441488:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787779627.441543:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e874221680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+8:2359:x1874622505056128:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 243us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779627.441551:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 36 00010000:00010000:1.0:1787779627.441708:0:6681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002f874b20/0x9e63ba8af6889303 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779627.441745:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f874b20/0x9e63ba8af6889303 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779627.441776:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f874b20/0x9e63ba8af6889303 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779627.441785:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002f874b20/0x9e63ba8af6889303 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779627.441805:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002f874b20/0x9e63ba8af6889303 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779627.441812:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e8429d4400 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:1.0:1787779627.441825:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002f874b20/0x9e63ba8af6889303 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779627.441835:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002f874b20/0x9e63ba8af6889303 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779627.441850:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002f874b20/0x9e63ba8af6889303 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779627.441858:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f874b20/0x9e63ba8af6889303 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779627.441921:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ab18b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+7:2358:x1874622505055872:12345-192.168.201.9@tcp:1:lfs.0 Request processed in 74724us (75370us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779627.441930:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 23 00000100:00100000:1.0:1787779627.446077:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87a963840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874622525016192:0@lo:400:kworker.0 00000100:00100000:1.0:1787779627.446152:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779627.446205:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787779627.446211:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87a9630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622525016320:0@lo:400:kworker.0 00000100:00100000:1.0:1787779627.446239:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779627.446289:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525016192 00000100:00100000:1.0:1787779627.446296:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525016192 00000100:00100000:1.0:1787779627.446350:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787779627.446360:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a961e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874622525016192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779627.446413:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a961e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874622525016192:12345-0@lo:400:kworker.0 Request processed in 55us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779627.446421:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787779627.446457:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525016320 00000100:00100000:1.0:1787779627.446461:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525016320 00000100:00100000:1.0:1787779627.446485:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787779627.446491:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a960000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622525016320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779627.446521:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a960000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622525016320:12345-0@lo:400:kworker.0 Request processed in 31us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779627.446527:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:1.0:1787779627.446542:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787779627.446580:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87a9630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622525016320:0@lo:400:kworker.0 00000100:00100000:1.0:1787779627.446591:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87a963840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874622525016192:0@lo:400:kworker.0 00000100:00100000:2.0:1787779627.446738:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87a9612c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c28aae66-2825-42c5-8f52-61f687e868c9:3304:1874622525015936:0@lo:400:kworker.0 00000100:00100000:2.0:1787779627.446783:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779627.446810:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87a960780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874622525016448:0@lo:400:kworker.0 00000100:00100000:2.0:1787779627.446843:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779627.446862:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787779627.446868:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87a962940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874622525016064:0@lo:400:kworker.0 00000100:00100000:2.0:1787779627.446888:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779627.446903:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87a961680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874622525016576:0@lo:400:kworker.0 00000100:00100000:2.0:1787779627.446923:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779627.446949:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525016448 00000100:00100000:2.0:1787779627.446953:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525016448 00000100:00100000:2.0:1787779627.446991:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525016064 00000100:00100000:2.0:1787779627.446994:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525016064 00000100:00100000:2.0:1787779627.447011:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787779627.447017:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e8742212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874622525016448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779627.447052:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e8742212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874622525016448:12345-0@lo:400:kworker.0 Request processed in 35us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779627.447058:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787779627.447071:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787779627.447076:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e874222940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874622525016064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779627.447102:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e874222940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874622525016064:12345-0@lo:400:kworker.0 Request processed in 26us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779627.447108:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787779627.447124:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525016576 00000100:00100000:2.0:1787779627.447127:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525016576 00000100:00100000:2.0:1787779627.447150:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787779627.447155:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e874223840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874622525016576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779627.447193:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e874223840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874622525016576:12345-0@lo:400:kworker.0 Request processed in 38us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779627.447199:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787779627.447224:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87a962940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874622525016064:0@lo:400:kworker.0 00000100:00100000:2.0:1787779627.447233:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87a961680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874622525016576:0@lo:400:kworker.0 00000100:00100000:2.0:1787779627.447241:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87a960780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874622525016448:0@lo:400:kworker.0 00000100:00100000:1.0:1787779627.447460:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525015936 00000100:00100000:1.0:1787779627.447464:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525015936 00000100:00100000:1.0:1787779627.447498:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1787779627.447504:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ebdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+19:3304:x1874622525015936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779627.447541:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ebdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+19:3304:x1874622525015936:12345-0@lo:400:kworker.0 Request processed in 37us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779627.447546:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00080000:1.0:1787779627.447575:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787779627.447578:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787779627.447597:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87a9612c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c28aae66-2825-42c5-8f52-61f687e868c9:3304:1874622525015936:0@lo:400:kworker.0 00000100:00100000:2.0:1787779627.454052:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779627.454203:0:11475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505056384 00000100:00100000:1.0:1787779627.454214:0:11475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505056384 00000100:00100000:1.0:1787779627.454281:0:11475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 8 00000100:00100000:1.0:1787779627.454292:0:11475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e8742230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+19:10322:x1874622505056384:12345-192.168.201.9@tcp:35:lfs.0 00000004:00010000:1.0:1787779627.454367:0:11475:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af68892f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac95 expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787779627.454691:0:11475:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:1.0:1787779627.455138:0:11475:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:1.0:1787779627.456339:0:11475:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:1.0:1787779627.456405:0:11475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af688930a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779627.456424:0:11475:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67600/0x9e63ba8af688929a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac6b expref: 23 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779627.456432:0:11475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af688930a lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779627.458107:0:11475:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67600/0x9e63ba8af688929a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac6b expref: 23 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779627.458126:0:11475:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67600/0x9e63ba8af688929a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac6b expref: 23 pid: 5837 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779627.458142:0:11475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87a9612c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:11475:1874622525016704:192.168.201.9@tcp:104: 00000100:00100000:1.0:1787779627.458237:0:11475:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e846ae89c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787779627.462524:0:11475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87a9612c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:11475:1874622525016704:192.168.201.9@tcp:104: 00010000:00010000:1.0:1787779627.462570:0:11475:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af688930a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11475 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779627.464490:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779627.464753:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505056512 00000100:00100000:3.0:1787779627.464769:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505056512 00010000:00010000:3.0:1787779627.465184:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67600/0x9e63ba8af688929a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac6b expref: 24 pid: 5837 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779627.465229:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 37 00000100:00100000:3.0:1787779627.465241:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e874220780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+24:2360:x1874622505056512:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787779627.465256:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787779627.465263:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67600/0x9e63ba8af688929a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac6b expref: 24 pid: 5837 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779627.465276:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67600/0x9e63ba8af688929a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac6b expref: 24 pid: 5837 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779627.465318:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67600/0x9e63ba8af688929a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac6b expref: 24 pid: 5837 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779627.465333:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e84927fd00) 00010000:00010000:3.0:1787779627.465338:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af688930a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779627.465347:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af688930a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779627.465354:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af688930a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779627.465385:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787779627.465449:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e874220780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+23:2360:x1874622505056512:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 211us (967us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779627.465456:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 37 00010000:00010000:1.0:1787779627.465529:0:11475:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af688930a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779627.465537:0:11475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af688930a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11475 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787779627.465673:0:11475:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:1.0:1787779627.466261:0:11475:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:1.0:1787779627.466370:0:11475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87a9612c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:11475:1874622525016832:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1787779627.468492:0:11475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779627.468527:0:11475:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e8495b7a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787779627.468770:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525016832 00000100:00100000:3.0:1787779627.468779:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525016832 00000100:00100000:3.0:1787779627.469186:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787779627.469195:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a963840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:11475:x1874622525016832:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1787779627.469298:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a963840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:11475:x1874622525016832:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 104us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779627.469306:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787779627.469476:0:11475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87a9612c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:11475:1874622525016832:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:1.0:1787779627.472253:0:11475:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:1.0:1787779627.472347:0:11475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87a9612c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:11475:1874622525016960:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1787779627.472408:0:11475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779627.472560:0:11475:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e846ae89c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787779627.474193:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525016960 00000100:00100000:3.0:1787779627.474205:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525016960 00000100:00100000:3.0:1787779627.474271:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787779627.474280:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a9630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:11475:x1874622525016960:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1787779627.474539:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a9630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:11475:x1874622525016960:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 260us (2129us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1787779627.474547:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787779627.474682:0:11475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87a9612c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:11475:1874622525016960:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:1.0:1787779627.474808:0:11475:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:1.0:1787779627.474864:0:11475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af688930a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779627.474874:0:11475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af688930a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779627.474881:0:11475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af688930a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779627.474898:0:11475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87a98aa00 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:1.0:1787779627.474902:0:11475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af688930a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779627.474909:0:11475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af688930a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779627.474925:0:11475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e84927fd00) 00010000:00010000:1.0:1787779627.474927:0:11475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787779627.474932:0:11475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af688930a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779627.474938:0:11475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af688930a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11475 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787779627.475121:0:11475:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787779627.475333:0:11475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1787779627.475344:0:11475:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 393216631731ns, next at 394216629748ns, rc = 0 00000001:00080000:1.0:1787779627.475350:0:11475:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:1.0:1787779627.475382:0:11475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e84927fd00) 00010000:00010000:1.0:1787779627.475385:0:11475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787779627.475392:0:11475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af68892f5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac95 expref: 27 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779627.475509:0:11475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e8742230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+26:10322:x1874622505056384:12345-192.168.201.9@tcp:35:lfs.0 Request processed in 21219us (21467us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1787779627.475518:0:11475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 8 00000020:00080000:1.0:1787779627.475522:0:11475:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1787779627.481113:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779627.481203:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505056640 00000100:00100000:1.0:1787779627.481214:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505056640 00000100:00100000:1.0:1787779627.481273:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 45 00000100:00100000:1.0:1787779627.481283:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e845d2de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+26:10322:x1874622505056640:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:1.0:1787779627.481308:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779627.481332:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b800/0x9e63ba8af6889311 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedac9c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779627.481392:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b800/0x9e63ba8af6889311 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac9c expref: 27 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779627.481407:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b800/0x9e63ba8af6889311 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac9c expref: 27 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779627.481424:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e860c40b00) 00010000:00010000:1.0:1787779627.481427:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787779627.481431:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87a98b800, rc 0) 00000100:00100000:1.0:1787779627.481499:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e845d2de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+27:10322:x1874622505056640:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 217us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779627.481506:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 45 00000100:00100000:1.0:1787779627.484137:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779627.484339:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505056896 00000100:00100000:3.0:1787779627.484349:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505056896 00000100:00100000:3.0:1787779627.484403:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 9 00000100:00100000:3.0:1787779627.484414:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e86c75d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+27:10322:x1874622505056896:12345-192.168.201.9@tcp:35:lfs.0 00000100:00100000:3.0:1787779627.484669:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e86c75d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+28:10322:x1874622505056896:12345-192.168.201.9@tcp:35:lfs.0 Request processed in 256us (543us total) trans 4294967326 rc 0/0 00000100:00100000:3.0:1787779627.484677:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 9 00000100:00100000:1.0:1787779627.591441:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779627.591554:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505057152 00000100:00100000:2.0:1787779627.591565:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505057152 00000100:00100000:2.0:1787779627.591649:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 46 00000100:00100000:2.0:1787779627.591658:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a960b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+28:10332:x1874622505057152:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:2.0:1787779627.591683:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779627.591753:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67600/0x9e63ba8af6889318 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedaca3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787779627.591894:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1787779627.592017:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67600/0x9e63ba8af6889318 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaca3 expref: 30 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779627.592031:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e860c40100) 00010000:00010000:2.0:1787779627.592033:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787779627.592039:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67600/0x9e63ba8af6889318 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaca3 expref: 30 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779627.592052:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87aa67600, rc 0) 00000100:00100000:2.0:1787779627.592130:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a960b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+29:10332:x1874622505057152:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 472us (698us total) trans 4294967327 rc 301/301 00000100:00100000:2.0:1787779627.592137:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 46 00000100:00100000:1.0:1787779627.598380:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779627.598462:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505057280 00000100:00100000:2.0:1787779627.598473:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505057280 00000100:00100000:2.0:1787779627.598533:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 47 00000100:00100000:2.0:1787779627.598543:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a962580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+29:10332:x1874622505057280:12345-192.168.201.9@tcp:34:lfs.0 00010000:00010000:2.0:1787779627.598626:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67200/0x9e63ba8af6889326 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779627.598643:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67200/0x9e63ba8af6889326 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779627.598657:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67200/0x9e63ba8af6889326 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779627.598670:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66400/0x9e63ba8af688932d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779627.598676:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66400/0x9e63ba8af688932d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779627.598682:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66400/0x9e63ba8af688932d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779627.598849:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67600/0x9e63ba8af6889334 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779627.598859:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67600/0x9e63ba8af6889334 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779627.598866:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67600/0x9e63ba8af6889334 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787779627.598931:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67600/0x9e63ba8af6889334 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779627.598944:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67200/0x9e63ba8af6889326 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779627.598951:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67200/0x9e63ba8af6889326 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779627.598958:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67200/0x9e63ba8af6889326 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779627.598976:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87aa67200 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:2.0:1787779627.598981:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67200/0x9e63ba8af6889326 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779627.598989:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67200/0x9e63ba8af6889326 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779627.599002:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98e87450a200) 00010000:00010000:2.0:1787779627.599005:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787779627.599010:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67200/0x9e63ba8af6889326 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779627.599016:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67200/0x9e63ba8af6889326 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779627.599029:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66400/0x9e63ba8af688932d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779627.599035:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66400/0x9e63ba8af688932d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779627.599047:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66400/0x9e63ba8af688932d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779627.599053:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87aa66400 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:2.0:1787779627.599056:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66400/0x9e63ba8af688932d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779627.599063:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66400/0x9e63ba8af688932d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779627.599070:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98e84927f800) 00010000:00010000:2.0:1787779627.599073:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787779627.599076:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66400/0x9e63ba8af688932d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779627.599082:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66400/0x9e63ba8af688932d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779627.599105:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67600/0x9e63ba8af6889334 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779627.599111:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67600/0x9e63ba8af6889334 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779627.599118:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67600/0x9e63ba8af6889334 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779627.599123:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87aa67600 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:2.0:1787779627.599126:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67600/0x9e63ba8af6889334 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779627.599140:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67600/0x9e63ba8af6889334 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779627.599148:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e860c40b00) 00010000:00010000:2.0:1787779627.599151:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787779627.599154:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67600/0x9e63ba8af6889334 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779627.599161:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67600/0x9e63ba8af6889334 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779627.599234:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a962580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+29:10332:x1874622505057280:12345-192.168.201.9@tcp:34:lfs.0 Request processed in 691us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779627.599243:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 47 00000100:00100000:3.0:1787779627.601436:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779627.601530:0:11475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505057536 00000100:00100000:1.0:1787779627.601540:0:11475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505057536 00000100:00100000:1.0:1787779627.601629:0:11475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 10 00000100:00100000:1.0:1787779627.601639:0:11475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e845d2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+29:10332:x1874622505057536:12345-192.168.201.9@tcp:35:lfs.0 00000100:00100000:1.0:1787779627.601949:0:11475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e845d2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+30:10332:x1874622505057536:12345-192.168.201.9@tcp:35:lfs.0 Request processed in 311us (522us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1787779627.601970:0:11475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 10 00010000:00010000:0.0:1787779627.638412:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779627.658844:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779627.658923:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505057792 00000100:00100000:2.0:1787779627.658934:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505057792 00000100:00100000:2.0:1787779627.659068:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 48 00000100:00100000:2.0:1787779627.659079:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a963c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+30:10335:x1874622505057792:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:2.0:1787779627.659104:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779627.659125:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67600/0x9e63ba8af688933b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedacaa expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779627.659203:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66400/0x9e63ba8af6889342 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779627.659218:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66400/0x9e63ba8af6889342 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779627.659229:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66400/0x9e63ba8af6889342 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779627.659258:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67200/0x9e63ba8af6889349 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779627.659266:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67200/0x9e63ba8af6889349 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779627.659272:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67200/0x9e63ba8af6889349 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779627.659397:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af6889350 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779627.659406:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af6889350 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779627.659413:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af6889350 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787779627.659422:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787779627.661259:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66400/0x9e63ba8af6889342 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779627.661276:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66400/0x9e63ba8af6889342 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779627.661283:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66400/0x9e63ba8af6889342 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779627.661289:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87aa66400 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:2.0:1787779627.661294:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66400/0x9e63ba8af6889342 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779627.661318:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66400/0x9e63ba8af6889342 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779627.661333:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98e87450a200) 00010000:00010000:2.0:1787779627.661336:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787779627.661340:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66400/0x9e63ba8af6889342 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779627.661346:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66400/0x9e63ba8af6889342 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779627.661360:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67200/0x9e63ba8af6889349 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779627.661366:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67200/0x9e63ba8af6889349 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779627.661371:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67200/0x9e63ba8af6889349 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779627.661377:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87aa67200 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:2.0:1787779627.661380:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67200/0x9e63ba8af6889349 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779627.661386:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67200/0x9e63ba8af6889349 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779627.661393:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98e84927f800) 00010000:00010000:2.0:1787779627.661395:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787779627.661398:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67200/0x9e63ba8af6889349 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779627.661413:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67200/0x9e63ba8af6889349 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779627.662250:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67600/0x9e63ba8af688933b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedacaa expref: 33 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779627.662269:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af6889350 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedacaa expref: 32 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779627.662279:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e860c40b00) 00010000:00010000:2.0:1787779627.662281:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787779627.662284:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87aa66e00, rc 0) 00000100:00100000:2.0:1787779627.662359:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a963c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+32:10335:x1874622505057792:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 3282us (3525us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1787779627.662368:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 48 00000100:00100000:2.0:1787779627.667587:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779627.668834:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505057920 00000100:00100000:1.0:1787779627.668848:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505057920 00000100:00100000:1.0:1787779627.668926:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 49 00000100:00100000:1.0:1787779627.668936:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e874220000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+32:10335:x1874622505057920:12345-192.168.201.9@tcp:54:lfs.0 00010000:00010000:1.0:1787779627.669008:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af688935e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779627.669027:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af688935e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779627.669039:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af688935e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779627.669066:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af688935e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779627.669074:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af688935e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779627.669081:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af688935e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779627.669088:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87a98a400 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:1.0:1787779627.669092:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af688935e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779627.669100:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af688935e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779627.669134:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e860c40b00) 00010000:00010000:1.0:1787779627.669137:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787779627.669144:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af688935e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779627.669151:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af688935e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779627.669243:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e874220000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+32:10335:x1874622505057920:12345-192.168.201.9@tcp:54:lfs.0 Request processed in 307us (1667us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779627.669251:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 49 00000100:00100000:3.0:1787779627.678836:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779627.679205:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505058176 00000100:00100000:0.0:1787779627.679228:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505058176 00000100:00100000:0.0:1787779627.679288:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 11 00000100:00100000:0.0:1787779627.679300:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e845d2e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+32:10335:x1874622505058176:12345-192.168.201.9@tcp:35:lfs.0 00000100:00100000:0.0:1787779627.679560:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e845d2e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+33:10335:x1874622505058176:12345-192.168.201.9@tcp:35:lfs.0 Request processed in 262us (732us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1787779627.679568:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 11 00000100:00100000:1.0:1787779627.956233:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787779627.956257:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e842fef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622525017088:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787779627.956327:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779627.956694:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525017088 00000100:00100000:0.0:1787779627.956703:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525017088 00000100:00100000:0.0:1787779627.957036:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787779627.957058:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a962d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1874622525017088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787779627.957097:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787779627.957192:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a962d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1874622525017088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 134us (851us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779627.957200:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787779627.957480:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e842fef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622525017088:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787779627.970333:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779627.970559:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505058432 00000100:00100000:1.0:1787779627.970570:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505058432 00000100:00100000:1.0:1787779627.970634:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 50 00000100:00100000:1.0:1787779627.970644:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842fef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+33:10367:x1874622505058432:12345-192.168.201.9@tcp:101:cat.0 00010000:00010000:1.0:1787779627.970672:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779627.970708:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af6889365 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedacb1 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779627.970894:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98bc00/0x9e63ba8af688936c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779627.970910:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98bc00/0x9e63ba8af688936c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779627.970928:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98bc00/0x9e63ba8af688936c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787779627.970940:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787779627.971107:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af6889365 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedacb1 expref: 36 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779627.971126:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98bc00/0x9e63ba8af688936c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedacb1 expref: 35 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779627.971136:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e860c40b00) 00010000:00010000:1.0:1787779627.971139:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787779627.971143:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87a98bc00, rc 0) 00000100:00100000:1.0:1787779627.971210:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842fef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+35:10367:x1874622505058432:12345-192.168.201.9@tcp:101:cat.0 Request processed in 567us (899us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1787779627.971217:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 50 00000100:00100000:2.0:1787779627.974687:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779627.974788:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779627.975177:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505058688 00000100:00100000:3.0:1787779627.975188:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505058688 00000100:00100000:3.0:1787779627.975249:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 12 00000100:00100000:3.0:1787779627.975260:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e874222d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+35:10367:x1874622505058688:12345-192.168.201.9@tcp:35:cat.0 00000100:00100000:3.0:1787779627.975531:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e874222d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+36:10367:x1874622505058688:12345-192.168.201.9@tcp:35:cat.0 Request processed in 271us (854us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1787779627.975540:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 12 00000100:00100000:0.0:1787779627.976462:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505058816 00000100:00100000:0.0:1787779627.976470:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505058816 00000100:00100000:0.0:1787779627.976527:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 3 00000100:00100000:0.0:1787779627.976536:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e847d97050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+36:2360:x1874622505058816:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787779627.976548:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787779627.976573:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98bc00/0x9e63ba8af688936c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedacb1 expref: 36 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779627.976591:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e860c40b00) 00010000:00010000:0.0:1787779627.976597:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787779627.976639:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e847d97050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+35:2360:x1874622505058816:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 104us (1851us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779627.976664:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 3 00000100:00100000:2.0:1787779628.048050:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779628.048632:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505059072 00000100:00100000:1.0:1787779628.048644:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505059072 00000100:00100000:1.0:1787779628.048763:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 51 00000100:00100000:1.0:1787779628.048778:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e874222580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+35:10373:x1874622505059072:12345-192.168.201.9@tcp:101:dd.0 00010000:00010000:1.0:1787779628.048817:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779628.048822:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787779628.048855:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af68892d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac87 expref: 35 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779628.048878:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98e87450a200) 00010000:00010000:1.0:1787779628.048884:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787779628.048916:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af688937a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedacb8 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779628.049052:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98bc00/0x9e63ba8af6889381 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779628.049066:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af6889350 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedacaa expref: 35 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779628.049075:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98bc00/0x9e63ba8af6889381 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779628.049107:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af6889350 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedacaa expref: 35 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779628.049123:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af6889350 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedacaa expref: 35 pid: 5836 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779628.049137:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87a960780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5837:1874622525017216:192.168.201.9@tcp:104: 00000100:00100000:1.0:1787779628.049294:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e84975f240 going to sleep for 11 seconds 00000100:00080000:2.0:1787779628.049459:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787779628.060367:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779628.060473:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87a960780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5837:1874622525017216:192.168.201.9@tcp:104: 00010000:00010000:1.0:1787779628.060505:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98bc00/0x9e63ba8af6889381 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779628.060577:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505059200 00000100:00100000:2.0:1787779628.060584:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505059200 00010000:00010000:2.0:1787779628.060621:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af6889350 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedacaa expref: 36 pid: 5836 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779628.060658:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 38 00000100:00100000:2.0:1787779628.060667:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ab343c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+36:2359:x1874622505059200:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787779628.060696:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787779628.060703:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af6889350 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedacaa expref: 36 pid: 5836 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779628.060760:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af6889350 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedacaa expref: 36 pid: 5836 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779628.060784:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af6889350 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedacaa expref: 36 pid: 5836 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779628.060799:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e860c40b00) 00010000:00010000:2.0:1787779628.060803:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98bc00/0x9e63ba8af6889381 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779628.060825:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98bc00/0x9e63ba8af6889381 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779628.060833:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98bc00/0x9e63ba8af6889381 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779628.060861:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787779628.060921:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ab343c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+35:2359:x1874622505059200:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 254us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779628.060929:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 38 00010000:00010000:1.0:1787779628.061217:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98bc00/0x9e63ba8af6889381 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779628.061225:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98bc00/0x9e63ba8af6889381 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787779628.061260:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787779628.061467:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af688937a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedacb8 expref: 36 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779628.061486:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98bc00/0x9e63ba8af6889381 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedacb8 expref: 35 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779628.061493:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e860c40b00) 00010000:00010000:1.0:1787779628.061496:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787779628.061499:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87a98bc00, rc 0) 00000100:00100000:1.0:1787779628.061531:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e874222580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+35:10373:x1874622505059072:12345-192.168.201.9@tcp:101:dd.0 Request processed in 12759us (13494us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1787779628.061538:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 51 00000100:00100000:0.0:1787779628.065498:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779628.065589:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505059456 00000100:00100000:1.0:1787779628.065598:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505059456 00000100:00100000:1.0:1787779628.065657:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 52 00000100:00100000:1.0:1787779628.065667:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842feda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+35:10373:x1874622505059456:12345-192.168.201.9@tcp:36:dd.0 00010000:00010000:1.0:1787779628.065998:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af688938f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779628.066015:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af688938f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779628.066026:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af688938f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787779628.066067:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:1.0:1787779628.066105:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c7e0a694 reply state 000000003dc50684 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af688938f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779628.066113:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787779628.066196:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842feda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+38:10373:x1874622505059456:12345-192.168.201.9@tcp:36:dd.0 Request processed in 530us (711us total) trans 4294967335 rc 0/0 00000100:00100000:1.0:1787779628.066203:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 52 00000020:00080000:1.0:1787779628.066207:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787779628.067985:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af688938f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779628.068000:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af688938f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779628.068024:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af688938f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779628.068031:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87a98a600 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:3.0:1787779628.068036:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af688938f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779628.068044:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af688938f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779628.068060:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e860c40b00) 00010000:00010000:3.0:1787779628.068064:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779628.068068:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af688938f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779628.068075:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af688938f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779628.420889:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779628.421026:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505059584 00000100:00100000:3.0:1787779628.421037:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505059584 00000100:00100000:3.0:1787779628.421104:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 53 00000100:00100000:3.0:1787779628.421115:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842fef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+37:10387:x1874622505059584:12345-192.168.201.9@tcp:101:stat.0 00010000:00010000:3.0:1787779628.421140:0:8197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779628.421161:0:8197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5800/0x9e63ba8af6889396 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedacbf expref: -99 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779628.421227:0:8197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5200/0x9e63ba8af688939d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779628.421241:0:8197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5200/0x9e63ba8af688939d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779628.421267:0:8197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5200/0x9e63ba8af688939d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779628.421282:0:8197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af68893a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779628.421290:0:8197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af68893a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779628.421296:0:8197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af68893a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779628.421411:0:8197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af68893ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779628.421432:0:8197:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98bc00/0x9e63ba8af6889381 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedacb8 expref: 38 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779628.421441:0:8197:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af68893ab lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779628.421474:0:8197:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98bc00/0x9e63ba8af6889381 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedacb8 expref: 38 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779628.421487:0:8197:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98bc00/0x9e63ba8af6889381 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedacb8 expref: 38 pid: 5837 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779628.421501:0:8197:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ab37480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8197:1874622525017344:192.168.201.9@tcp:104: 00000100:00100000:3.0:1787779628.421610:0:8197:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e87eb42540 going to sleep for 11 seconds 00000100:00100000:0.0:1787779628.425903:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779628.425992:0:11475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505059840 00000100:00100000:1.0:1787779628.426001:0:11475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505059840 00000100:00100000:1.0:1787779628.426059:0:11475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 13 00000100:00100000:1.0:1787779628.426067:0:11475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f61fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+39:5598:x1874622505059840:12345-192.168.201.9@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787779628.426597:0:11475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f61fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+40:5598:x1874622505059840:12345-192.168.201.9@tcp:35:ldlm_bl.0 Request processed in 529us (702us total) trans 4294967336 rc 0/0 00000100:00100000:1.0:1787779628.426615:0:11475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 13 00000100:00100000:3.0:1787779628.429077:0:8197:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ab37480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8197:1874622525017344:192.168.201.9@tcp:104: 00010000:00010000:3.0:1787779628.429107:0:8197:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af68893ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779628.429505:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779628.429628:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505059968 00000100:00100000:3.0:1787779628.429635:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505059968 00010000:00010000:3.0:1787779628.429671:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98bc00/0x9e63ba8af6889381 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedacb8 expref: 40 pid: 5837 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779628.429738:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 39 00000100:00100000:3.0:1787779628.429757:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f61f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+40:2357:x1874622505059968:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787779628.429771:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787779628.429778:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98bc00/0x9e63ba8af6889381 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedacb8 expref: 40 pid: 5837 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779628.429955:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98bc00/0x9e63ba8af6889381 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedacb8 expref: 40 pid: 5837 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779628.429983:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98bc00/0x9e63ba8af6889381 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedacb8 expref: 40 pid: 5837 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779628.430004:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e860c40b00) 00010000:00010000:3.0:1787779628.430009:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af68893ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779628.430019:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af68893ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779628.430028:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af68893ab lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779628.430085:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787779628.430140:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f61f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+39:2357:x1874622505059968:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 385us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779628.430148:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 39 00010000:00010000:0.0:1787779628.431606:0:8197:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af68893ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779628.431619:0:8197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af68893ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787779628.431664:0:8197:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787779628.431668:0:8197:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787779628.431734:0:8197:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af68893ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779628.431760:0:8197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af68893ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779628.431772:0:8197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5200/0x9e63ba8af688939d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779628.431778:0:8197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5200/0x9e63ba8af688939d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779628.432040:0:8197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5200/0x9e63ba8af688939d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779628.432047:0:8197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e8429d5200 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:0.0:1787779628.432051:0:8197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5200/0x9e63ba8af688939d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779628.432073:0:8197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5200/0x9e63ba8af688939d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779628.432085:0:8197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98e87450a200) 00010000:00010000:0.0:1787779628.432088:0:8197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787779628.432093:0:8197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5200/0x9e63ba8af688939d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779628.432099:0:8197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5200/0x9e63ba8af688939d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779628.432112:0:8197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af68893a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779628.432118:0:8197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af68893a4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779628.432124:0:8197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af68893a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779628.432129:0:8197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e8429d4000 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:0.0:1787779628.432132:0:8197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af68893a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779628.432138:0:8197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af68893a4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779628.432145:0:8197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98e87450aa00) 00010000:00010000:0.0:1787779628.432147:0:8197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787779628.432150:0:8197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af68893a4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779628.432166:0:8197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af68893a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779628.432209:0:8197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5800/0x9e63ba8af6889396 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedacbf expref: 39 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779628.432223:0:8197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af68893ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedacbf expref: 38 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779628.432230:0:8197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e860c40b00) 00010000:00010000:0.0:1787779628.432233:0:8197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787779628.432235:0:8197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e8429d5c00, rc 0) 00000100:00100000:0.0:1787779628.432347:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842fef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+38:10387:x1874622505059584:12345-192.168.201.9@tcp:101:stat.0 Request processed in 11233us (11466us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779628.432358:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 53 00000100:00100000:0.0:1787779628.504494:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779628.504598:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505060224 00000100:00100000:1.0:1787779628.504608:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505060224 00000100:00100000:1.0:1787779628.504674:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 54 00000100:00100000:1.0:1787779628.504682:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f61f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+38:10393:x1874622505060224:12345-192.168.201.9@tcp:36:truncate.0 00010000:00010000:1.0:1787779628.505292:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787779628.505339:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af68893ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedacbf expref: 38 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779628.505363:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e860c40b00) 00010000:00010000:1.0:1787779628.505369:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787779628.505585:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af68893b2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779628.505619:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af68893b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779628.505629:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af68893b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787779628.505683:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:1.0:1787779628.505826:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000046db8f2c reply state 000000002aeaf86f transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af68893b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779628.505836:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787779628.505961:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f61f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+40:10393:x1874622505060224:12345-192.168.201.9@tcp:36:truncate.0 Request processed in 1278us (1476us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1787779628.505970:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 54 00000020:00080000:1.0:1787779628.505976:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787779628.510564:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af68893b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779628.510582:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af68893b2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779628.510589:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af68893b2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779628.510596:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87a98a400 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:3.0:1787779628.510601:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af68893b2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779628.510609:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af68893b2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779628.510626:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e860c40b00) 00010000:00010000:3.0:1787779628.510629:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779628.510635:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af68893b2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779628.510642:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af68893b2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779628.668022:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779628.706986:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779628.709070:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505060352 00000100:00100000:1.0:1787779628.709082:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505060352 00000100:00100000:1.0:1787779628.709163:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 55 00000100:00100000:1.0:1787779628.709174:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f61c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+39:10407:x1874622505060352:12345-192.168.201.9@tcp:101:stat.0 00010000:00010000:1.0:1787779628.709198:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779628.709220:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af68893b9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedacc6 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779628.709288:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af68893c0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779628.709303:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af68893c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779628.709314:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af68893c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779628.709344:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af68893c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779628.709352:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af68893c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779628.709359:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af68893c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779628.709452:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af68893ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779628.709461:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af68893ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779628.709469:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af68893ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787779628.709505:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1787779628.709509:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787779628.709533:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af68893ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779628.709545:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af68893ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779628.709553:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af68893c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779628.709559:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af68893c0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779628.709575:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af68893c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779628.709582:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87a98b600 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:1.0:1787779628.709587:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af68893c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779628.709595:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af68893c0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779628.709608:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98e87450a200) 00010000:00010000:1.0:1787779628.709611:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787779628.709616:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af68893c0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779628.709623:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af68893c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779628.709638:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af68893c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779628.709645:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af68893c7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779628.709652:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af68893c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779628.709657:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87a98ae00 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:1.0:1787779628.709661:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af68893c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779628.709676:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af68893c7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779628.709685:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98e860c40500) 00010000:00010000:1.0:1787779628.709687:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787779628.709690:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af68893c7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779628.709696:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af68893c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779628.709774:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af68893b9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedacc6 expref: 41 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779628.709789:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af68893ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedacc6 expref: 40 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779628.711884:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e860c40b00) 00010000:00010000:1.0:1787779628.711888:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787779628.711892:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87a98a400, rc 0) 00000100:00100000:1.0:1787779628.711983:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f61c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+40:10407:x1874622505060352:12345-192.168.201.9@tcp:101:stat.0 Request processed in 2806us (5000us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779628.711994:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 55 00000100:00100000:0.0:1787779628.836765:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779628.836941:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505060608 00000100:00100000:2.0:1787779628.836951:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505060608 00000100:00100000:2.0:1787779628.837011:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 56 00000100:00100000:2.0:1787779628.837021:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e881d83c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+40:10417:x1874622505060608:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:2.0:1787779628.837053:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779628.837074:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af68893d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedaccd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787779628.837196:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1787779628.837324:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af68893d5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaccd expref: 42 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779628.837338:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e860c40100) 00010000:00010000:2.0:1787779628.837342:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787779628.837347:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af68893d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaccd expref: 42 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779628.837361:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87aa66200, rc 0) 00000100:00100000:2.0:1787779628.837435:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e881d83c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+41:10417:x1874622505060608:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 416us (727us total) trans 4294967339 rc 301/301 00000100:00100000:2.0:1787779628.837443:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 56 00000100:00100000:0.0:1787779628.852634:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779628.852756:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505060864 00000100:00100000:1.0:1787779628.852766:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505060864 00000100:00100000:1.0:1787779628.852839:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 14 00000100:00100000:1.0:1787779628.852850:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e881d80b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+41:10417:x1874622505060864:12345-192.168.201.9@tcp:35:lfs.0 00000100:00100000:1.0:1787779628.853115:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e881d80b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+42:10417:x1874622505060864:12345-192.168.201.9@tcp:35:lfs.0 Request processed in 267us (490us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1787779628.853123:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 14 00000100:00100000:0.0:1787779628.956323:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779628.956417:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505061120 00000100:00100000:3.0:1787779628.956428:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505061120 00000100:00100000:3.0:1787779628.956506:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 57 00000100:00100000:3.0:1787779628.956516:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e881d83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+42:10423:x1874622505061120:12345-192.168.201.9@tcp:101:bash.0 00010000:00010000:3.0:1787779628.956543:0:8197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779628.956564:0:8197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af68893e3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedacd4 expref: -99 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779628.956685:0:8197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5400/0x9e63ba8af68893ea lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779628.956700:0:8197:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af68893ce lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedacc6 expref: 43 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779628.956709:0:8197:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5400/0x9e63ba8af68893ea lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779628.956799:0:8197:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af68893ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedacc6 expref: 43 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779628.956813:0:8197:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af68893ce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedacc6 expref: 43 pid: 5837 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779628.956826:0:8197:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ab37480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8197:1874622525017472:192.168.201.9@tcp:104: 00000100:00100000:3.0:1787779628.956928:0:8197:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e87eb42540 going to sleep for 11 seconds 00000100:00100000:3.0:1787779628.959683:0:8197:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ab37480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8197:1874622525017472:192.168.201.9@tcp:104: 00010000:00010000:3.0:1787779628.960092:0:8197:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5400/0x9e63ba8af68893ea lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779628.967143:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779628.967481:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505061248 00000100:00100000:3.0:1787779628.967507:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505061248 00010000:00010000:3.0:1787779628.967555:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af68893ce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedacc6 expref: 44 pid: 5837 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779628.967599:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 40 00000100:00100000:3.0:1787779628.967609:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e881d81a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+44:2360:x1874622505061248:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787779628.967624:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787779628.967631:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af68893ce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedacc6 expref: 44 pid: 5837 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779628.967644:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af68893ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedacc6 expref: 44 pid: 5837 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779628.967665:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af68893ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedacc6 expref: 44 pid: 5837 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779628.967681:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e860c40b00) 00010000:00010000:3.0:1787779628.967687:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5400/0x9e63ba8af68893ea lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779628.967696:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5400/0x9e63ba8af68893ea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779628.967704:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5400/0x9e63ba8af68893ea lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779628.967773:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787779628.967837:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e881d81a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+43:2360:x1874622505061248:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 230us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779628.967852:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 40 00010000:00010000:3.0:1787779628.967876:0:8197:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5400/0x9e63ba8af68893ea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779628.967883:0:8197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5400/0x9e63ba8af68893ea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787779628.967901:0:8197:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:3.0:1787779628.971952:0:8197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af68893e3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedacd4 expref: 44 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779628.972000:0:8197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5400/0x9e63ba8af68893ea lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedacd4 expref: 43 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779628.972010:0:8197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e860c40b00) 00010000:00010000:3.0:1787779628.972014:0:8197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787779628.972018:0:8197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e8429d5400, rc 0) 00000100:00100000:3.0:1787779628.972106:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e881d83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+43:10423:x1874622505061120:12345-192.168.201.9@tcp:101:bash.0 Request processed in 15591us (15805us total) trans 4294967341 rc 0/0 00000100:00100000:3.0:1787779628.972115:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 57 00000100:00100000:0.0:1787779628.975562:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779628.975893:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505061504 00000100:00100000:2.0:1787779628.975903:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505061504 00000100:00100000:2.0:1787779628.975970:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 58 00000100:00100000:2.0:1787779628.975980:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e881d821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+43:10423:x1874622505061504:12345-192.168.201.9@tcp:36:bash.0 00010000:00010000:2.0:1787779628.976251:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af68893f8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779628.976270:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af68893f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779628.976283:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af68893f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787779628.976352:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:2.0:1787779628.976376:0:5836:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000083df9e5f reply state 000000003f526617 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af68893f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779628.976385:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787779628.976484:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e881d821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+46:10423:x1874622505061504:12345-192.168.201.9@tcp:36:bash.0 Request processed in 505us (931us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1787779628.976491:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 58 00000020:00080000:2.0:1787779628.976496:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787779628.983984:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af68893f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779628.984006:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af68893f8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779628.984016:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af68893f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779628.984044:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87aa66200 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:3.0:1787779628.984050:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af68893f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779628.984060:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af68893f8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779628.984079:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e860c40b00) 00010000:00010000:3.0:1787779628.984082:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779628.984088:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af68893f8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779628.984094:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af68893f8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779628.985854:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779628.986847:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505061632 00000100:00100000:1.0:1787779628.986858:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505061632 00000100:00100000:1.0:1787779628.986916:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 59 00000100:00100000:1.0:1787779628.986926:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e881d803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+45:10423:x1874622505061632:12345-192.168.201.9@tcp:101:bash.0 00010000:00010000:1.0:1787779628.986961:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779628.986983:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af68893ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedacdb expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779628.987062:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889406 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779628.987077:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5400/0x9e63ba8af68893ea lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedacd4 expref: 46 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779628.987086:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889406 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779628.987120:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5400/0x9e63ba8af68893ea lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedacd4 expref: 46 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779628.987134:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5400/0x9e63ba8af68893ea lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedacd4 expref: 46 pid: 8197 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779628.987148:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87a960780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5837:1874622525017600:192.168.201.9@tcp:104: 00000100:00100000:1.0:1787779628.987250:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e845d95e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787779628.996170:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779628.996241:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505061760 00000100:00100000:3.0:1787779628.996250:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505061760 00010000:00010000:3.0:1787779628.996289:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5400/0x9e63ba8af68893ea lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedacd4 expref: 47 pid: 8197 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779628.996333:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 41 00000100:00100000:3.0:1787779628.996342:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e881d80f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+47:2359:x1874622505061760:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787779628.996357:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787779628.996364:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5400/0x9e63ba8af68893ea lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedacd4 expref: 47 pid: 8197 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779628.996378:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5400/0x9e63ba8af68893ea lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedacd4 expref: 47 pid: 8197 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779628.996420:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e860c40b00) 00010000:00010000:3.0:1787779628.996425:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889406 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779628.996434:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889406 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779628.996441:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889406 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779628.996466:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787779628.996527:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e881d80f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+47:2359:x1874622505061760:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 186us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779628.996535:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 41 00010000:00010000:1.0:1787779628.997872:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5400/0x9e63ba8af68893ea lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedacd4 expref: 46 pid: 8197 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779628.997896:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87a960780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5837:1874622525017600:192.168.201.9@tcp:104: 00010000:00010000:1.0:1787779628.997919:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889406 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779628.997929:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889406 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779628.997935:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889406 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787779628.997998:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787779628.998002:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787779628.998024:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889406 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779628.998056:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af68893ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedacdb expref: 46 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779628.998071:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889406 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedacdb expref: 45 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779628.998080:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e860c40b00) 00010000:00010000:1.0:1787779628.998083:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787779628.998086:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87a98ae00, rc 0) 00000100:00100000:1.0:1787779628.998851:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e881d803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+45:10423:x1874622505061632:12345-192.168.201.9@tcp:101:bash.0 Request processed in 11923us (13002us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779628.998877:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 59 00000100:00100000:0.0:1787779629.002297:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779629.002387:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505062016 00000100:00100000:2.0:1787779629.002397:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505062016 00000100:00100000:2.0:1787779629.002462:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 15 00000100:00100000:2.0:1787779629.002472:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e86c75c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+45:10423:x1874622505062016:12345-192.168.201.9@tcp:35:bash.0 00000100:00100000:2.0:1787779629.002707:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e86c75c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+46:10423:x1874622505062016:12345-192.168.201.9@tcp:35:bash.0 Request processed in 237us (420us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1787779629.002755:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 15 00000100:00100000:0.0:1787779629.118764:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779629.118985:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505062272 00000100:00100000:2.0:1787779629.118995:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505062272 00000100:00100000:2.0:1787779629.119054:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 60 00000100:00100000:2.0:1787779629.119063:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e881d81680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+46:10433:x1874622505062272:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:2.0:1787779629.119089:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779629.119110:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66600/0x9e63ba8af688940d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedace2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787779629.119228:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1787779629.119342:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66600/0x9e63ba8af688940d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedace2 expref: 48 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.119362:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e860c40100) 00010000:00010000:2.0:1787779629.119365:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787779629.119371:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66600/0x9e63ba8af688940d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedace2 expref: 48 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.119385:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87aa66600, rc 0) 00000100:00100000:2.0:1787779629.119444:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e881d81680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+47:10433:x1874622505062272:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 382us (734us total) trans 4294967345 rc 301/301 00000100:00100000:2.0:1787779629.119452:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 60 00000100:00100000:0.0:1787779629.125909:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779629.127002:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505062400 00000100:00100000:3.0:1787779629.127014:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505062400 00000100:00100000:0.0:1787779629.127194:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 61 00000100:00100000:0.0:1787779629.127205:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e881d812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+47:10433:x1874622505062400:12345-192.168.201.9@tcp:34:lfs.0 00010000:00010000:0.0:1787779629.127282:0:8197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68e00/0x9e63ba8af688941b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779629.127370:0:8197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68e00/0x9e63ba8af688941b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779629.127384:0:8197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68e00/0x9e63ba8af688941b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779629.127400:0:8197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af6889422 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779629.127417:0:8197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af6889422 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779629.127425:0:8197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af6889422 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779629.127526:0:8197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69e00/0x9e63ba8af6889429 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779629.127535:0:8197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69e00/0x9e63ba8af6889429 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779629.127542:0:8197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69e00/0x9e63ba8af6889429 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787779629.127585:0:8197:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69e00/0x9e63ba8af6889429 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779629.127617:0:8197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68e00/0x9e63ba8af688941b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779629.127623:0:8197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68e00/0x9e63ba8af688941b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779629.127631:0:8197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68e00/0x9e63ba8af688941b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779629.127637:0:8197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e848f68e00 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:0.0:1787779629.127641:0:8197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68e00/0x9e63ba8af688941b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779629.127649:0:8197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68e00/0x9e63ba8af688941b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779629.127662:0:8197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98e87450a200) 00010000:00010000:0.0:1787779629.127664:0:8197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787779629.127669:0:8197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68e00/0x9e63ba8af688941b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779629.127675:0:8197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68e00/0x9e63ba8af688941b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779629.127686:0:8197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af6889422 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779629.128004:0:8197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af6889422 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779629.128011:0:8197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af6889422 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779629.128024:0:8197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e848f69800 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:0.0:1787779629.128027:0:8197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af6889422 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779629.128033:0:8197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af6889422 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779629.128042:0:8197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98e860e78900) 00010000:00010000:0.0:1787779629.128045:0:8197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787779629.128048:0:8197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af6889422 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779629.128053:0:8197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af6889422 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779629.128070:0:8197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69e00/0x9e63ba8af6889429 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779629.128076:0:8197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69e00/0x9e63ba8af6889429 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779629.128082:0:8197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69e00/0x9e63ba8af6889429 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779629.128087:0:8197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e848f69e00 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:0.0:1787779629.128090:0:8197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69e00/0x9e63ba8af6889429 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779629.128095:0:8197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69e00/0x9e63ba8af6889429 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779629.128111:0:8197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e860c40b00) 00010000:00010000:0.0:1787779629.128113:0:8197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787779629.128128:0:8197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69e00/0x9e63ba8af6889429 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779629.128133:0:8197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69e00/0x9e63ba8af6889429 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779629.128221:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e881d812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+47:10433:x1874622505062400:12345-192.168.201.9@tcp:34:lfs.0 Request processed in 1016us (2321us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779629.128230:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 61 00000100:00100000:3.0:1787779629.131769:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779629.131899:0:11475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505062656 00000100:00100000:1.0:1787779629.131908:0:11475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505062656 00000100:00100000:1.0:1787779629.131963:0:11475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 16 00000100:00100000:1.0:1787779629.131973:0:11475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ab37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+47:10433:x1874622505062656:12345-192.168.201.9@tcp:35:lfs.0 00000100:00100000:1.0:1787779629.132218:0:11475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ab37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+48:10433:x1874622505062656:12345-192.168.201.9@tcp:35:lfs.0 Request processed in 245us (506us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1787779629.132226:0:11475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 16 00000100:00100000:3.0:1787779629.179927:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779629.180202:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505062912 00000100:00100000:2.0:1787779629.180211:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505062912 00000100:00100000:2.0:1787779629.180272:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 62 00000100:00100000:2.0:1787779629.180282:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ab361c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+48:10436:x1874622505062912:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:2.0:1787779629.180320:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779629.180340:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66600/0x9e63ba8af6889430 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedace9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.180415:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67400/0x9e63ba8af6889437 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.180430:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67400/0x9e63ba8af6889437 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.180440:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67400/0x9e63ba8af6889437 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.180454:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af688943e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.180475:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af688943e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.180482:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af688943e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.180602:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67a00/0x9e63ba8af6889445 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.180611:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67a00/0x9e63ba8af6889445 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.180618:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67a00/0x9e63ba8af6889445 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787779629.180627:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787779629.180773:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67400/0x9e63ba8af6889437 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.180781:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67400/0x9e63ba8af6889437 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.180797:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67400/0x9e63ba8af6889437 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.180802:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87aa67400 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:2.0:1787779629.180806:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67400/0x9e63ba8af6889437 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.180814:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67400/0x9e63ba8af6889437 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.180836:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98e87450a200) 00010000:00010000:2.0:1787779629.180839:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787779629.180844:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67400/0x9e63ba8af6889437 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.180851:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67400/0x9e63ba8af6889437 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.180863:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af688943e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.180870:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af688943e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.180875:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af688943e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.180880:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87aa67e00 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:2.0:1787779629.180883:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af688943e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.180889:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af688943e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.180896:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98e84927f800) 00010000:00010000:2.0:1787779629.180898:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787779629.180900:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af688943e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.180905:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af688943e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.180961:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66600/0x9e63ba8af6889430 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedace9 expref: 51 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.180975:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67a00/0x9e63ba8af6889445 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedace9 expref: 50 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.180983:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e860c40b00) 00010000:00010000:2.0:1787779629.180985:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787779629.180988:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87aa67a00, rc 0) 00000100:00100000:2.0:1787779629.181045:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ab361c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+50:10436:x1874622505062912:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 765us (1129us total) trans 4294967347 rc 0/0 00000100:00100000:2.0:1787779629.181052:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 62 00000100:00100000:1.0:1787779629.187043:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779629.187085:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779629.187196:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505063040 00000100:00100000:2.0:1787779629.187206:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505063040 00000100:00100000:2.0:1787779629.187268:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 63 00000100:00100000:2.0:1787779629.187279:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a960780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+50:10436:x1874622505063040:12345-192.168.201.9@tcp:54:lfs.0 00010000:00010000:2.0:1787779629.187357:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67000/0x9e63ba8af6889453 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.187374:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67000/0x9e63ba8af6889453 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.187385:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67000/0x9e63ba8af6889453 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.187422:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67000/0x9e63ba8af6889453 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.187446:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67000/0x9e63ba8af6889453 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.187453:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67000/0x9e63ba8af6889453 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.187460:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87aa67000 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:2.0:1787779629.187464:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67000/0x9e63ba8af6889453 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.187472:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67000/0x9e63ba8af6889453 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.187485:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e860c40b00) 00010000:00010000:2.0:1787779629.187488:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787779629.187493:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67000/0x9e63ba8af6889453 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.187499:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67000/0x9e63ba8af6889453 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779629.187567:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a960780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+50:10436:x1874622505063040:12345-192.168.201.9@tcp:54:lfs.0 Request processed in 290us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779629.187576:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 63 00000100:00100000:3.0:1787779629.188128:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505063168 00000100:00100000:3.0:1787779629.188134:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505063168 00000100:00100000:3.0:1787779629.188184:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 4 00000100:00100000:3.0:1787779629.188192:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a961680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+50:2357:x1874622505063168:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787779629.188203:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787779629.188220:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67a00/0x9e63ba8af6889445 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedace9 expref: 50 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779629.188233:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e860c40b00) 00010000:00010000:3.0:1787779629.188243:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787779629.188267:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a961680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+49:2357:x1874622505063168:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 77us (1182us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779629.188274:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 4 00000100:00100000:0.0:1787779629.190841:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779629.191008:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505063424 00000100:00100000:1.0:1787779629.191016:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505063424 00000100:00100000:1.0:1787779629.191068:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 17 00000100:00100000:1.0:1787779629.191077:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e881d82940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+49:10436:x1874622505063424:12345-192.168.201.9@tcp:35:lfs.0 00000100:00100000:1.0:1787779629.191320:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e881d82940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+50:10436:x1874622505063424:12345-192.168.201.9@tcp:35:lfs.0 Request processed in 243us (488us total) trans 4294967348 rc 0/0 00000100:00100000:1.0:1787779629.191329:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 17 00000100:00100000:3.0:1787779629.431931:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779629.432106:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505063680 00000100:00100000:2.0:1787779629.432115:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505063680 00000100:00100000:2.0:1787779629.432171:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 64 00000100:00100000:2.0:1787779629.432179:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ab19a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+50:10454:x1874622505063680:12345-192.168.201.9@tcp:101:cat.0 00010000:00010000:2.0:1787779629.432204:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779629.432235:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67000/0x9e63ba8af688945a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedacf0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.432321:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66600/0x9e63ba8af6889461 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.432335:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66600/0x9e63ba8af6889461 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.432348:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66600/0x9e63ba8af6889461 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787779629.432357:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787779629.432485:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67000/0x9e63ba8af688945a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedacf0 expref: 53 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.432502:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66600/0x9e63ba8af6889461 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedacf0 expref: 52 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.432510:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e860c40b00) 00010000:00010000:2.0:1787779629.432513:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787779629.432516:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87aa66600, rc 0) 00000100:00100000:2.0:1787779629.432845:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ab19a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+52:10454:x1874622505063680:12345-192.168.201.9@tcp:101:cat.0 Request processed in 531us (789us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1787779629.432854:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 64 00000100:00100000:0.0:1787779629.465379:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779629.465529:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505063808 00000100:00100000:2.0:1787779629.465539:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505063808 00000100:00100000:2.0:1787779629.465603:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 65 00000100:00100000:2.0:1787779629.465612:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e881d83840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+52:10455:x1874622505063808:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:2.0:1787779629.465652:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779629.465673:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67000/0x9e63ba8af688946f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedacf7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.465793:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af6889476 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.465808:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af6889476 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.465820:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af6889476 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787779629.465880:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1787779629.465884:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787779629.465905:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af6889476 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.465930:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67000/0x9e63ba8af688946f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedacf7 expref: 54 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.465949:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af6889476 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedacf7 expref: 53 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.465957:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98e87450a200) 00010000:00010000:2.0:1787779629.465960:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787779629.465963:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87aa67e00, rc 0) 00000100:00100000:2.0:1787779629.466024:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e881d83840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+53:10455:x1874622505063808:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 413us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779629.466032:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 65 00000100:00100000:1.0:1787779629.480430:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779629.480569:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505064192 00000100:00100000:3.0:1787779629.480580:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505064192 00000100:00100000:3.0:1787779629.480644:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 18 00000100:00100000:3.0:1787779629.480654:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a962940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+53:10455:x1874622505064192:12345-192.168.201.9@tcp:35:lfs.0 00000100:00100000:3.0:1787779629.482108:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a962940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+54:10455:x1874622505064192:12345-192.168.201.9@tcp:35:lfs.0 Request processed in 1449us (1683us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1787779629.482120:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 18 00000100:00100000:3.0:1787779629.496548:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779629.496579:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505064320 00000100:00100000:3.0:1787779629.497071:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505064320 00000100:00100000:3.0:1787779629.497129:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 5 00000100:00100000:3.0:1787779629.497139:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ab19680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+54:10455:x1874622505064320:12345-192.168.201.9@tcp:103:lfs.0 00010000:00010000:3.0:1787779629.497153:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787779629.497178:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889406 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedacdb expref: 54 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779629.497201:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66600/0x9e63ba8af6889461 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedacf0 expref: 53 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779629.497213:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b800/0x9e63ba8af6889311 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac9c expref: 52 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779629.497242:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e860c40b00) 00010000:00010000:3.0:1787779629.497254:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787779629.497306:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ab19680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+51:10455:x1874622505064320:12345-192.168.201.9@tcp:103:lfs.0 Request processed in 168us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779629.497314:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 5 00000100:00100000:3.0:1787779629.504059:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779629.504089:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505064448 00000100:00100000:3.0:1787779629.504097:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505064448 00000100:00100000:3.0:1787779629.504138:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 66 00000100:00100000:3.0:1787779629.504146:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e852b9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+51:10455:x1874622505064448:12345-192.168.201.9@tcp:58:lfs.0 00010000:00010000:3.0:1787779629.504250:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af688947d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779629.504266:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af688947d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779629.504278:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af688947d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787779629.505319:0:5836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787779629.505499:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:3.0:1787779629.505554:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1787779629.509317:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e852b9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+51:10455:x1874622505064448:12345-192.168.201.9@tcp:58:lfs.0 Request processed in 5159us (5254us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779629.509332:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 66 00000100:00100000:1.0:1787779629.543322:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779629.543881:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505064576 00000100:00100000:3.0:1787779629.543891:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505064576 00000100:00100000:3.0:1787779629.543942:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 67 00000100:00100000:3.0:1787779629.543952:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87fd2ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+51:10457:x1874622505064576:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:3.0:1787779629.543973:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779629.544003:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5400/0x9e63ba8af6889484 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedacfe expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779629.544067:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af688948b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779629.544082:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af688948b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779629.544094:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af688948b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779629.544109:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5800/0x9e63ba8af6889492 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779629.544116:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5800/0x9e63ba8af6889492 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779629.544122:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5800/0x9e63ba8af6889492 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779629.544380:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af6889499 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779629.544390:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af6889499 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779629.544396:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af6889499 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787779629.548642:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787779629.548647:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787779629.548670:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af6889499 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779629.548896:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af6889499 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779629.548908:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af688948b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779629.548915:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af688948b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779629.548921:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af688948b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779629.548927:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e8429d5c00 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:3.0:1787779629.548931:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af688948b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779629.548939:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af688948b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779629.548952:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98e87450a200) 00010000:00010000:3.0:1787779629.548955:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779629.548960:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af688948b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779629.548967:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af688948b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779629.548985:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5800/0x9e63ba8af6889492 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779629.548992:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5800/0x9e63ba8af6889492 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779629.549005:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5800/0x9e63ba8af6889492 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779629.549010:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e8429d5800 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:3.0:1787779629.549013:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5800/0x9e63ba8af6889492 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779629.549020:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5800/0x9e63ba8af6889492 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779629.549029:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98e87450a400) 00010000:00010000:3.0:1787779629.549031:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779629.549035:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5800/0x9e63ba8af6889492 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779629.549041:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5800/0x9e63ba8af6889492 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779629.549085:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5400/0x9e63ba8af6889484 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedacfe expref: 53 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779629.549099:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af6889499 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedacfe expref: 52 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779629.549107:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e87450a600) 00010000:00010000:3.0:1787779629.549109:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787779629.549112:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e8429d4000, rc 0) 00000100:00100000:3.0:1787779629.549182:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87fd2ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+52:10457:x1874622505064576:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 5230us (5868us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779629.549198:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 67 00000001:00080000:0.0:1787779629.608766:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967330 is committed 00000001:00080000:0.0:1787779629.608800:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967348 is committed 00000004:00080000:0.0:1787779629.608820:0:5857:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:0.0:1787779629.608843:0:5857:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98e84764e240 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1787779629.608848:0:5857:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98e8509b4000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98e84764e900 00000020:00080000:0.0:1787779629.608851:0:5857:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98e8509b4200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98e87f4f9800 00000001:00080000:0.0:1787779629.608878:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967349 is committed 00000001:00080000:0.0:1787779629.608900:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967350 is committed 00000100:00100000:3.0:1787779629.609248:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e874222d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622525017728:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787779629.609312:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779629.609604:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525017728 00000100:00100000:2.0:1787779629.609612:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525017728 00000100:00100000:2.0:1787779629.609667:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787779629.609677:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e852b9ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1874622525017728:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787779629.609701:0:6680:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:2.0:1787779629.609761:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a8f5a2a, atime: 0x6a8f5a2a, ctime: 0x6a8f5a2a, blocks: 0x1 00010000:00010000:2.0:1787779629.609769:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c41c716/0x9e63ba8af68894a0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.609803:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=395s v=(0 0) 00010000:00010000:2.0:1787779629.609808:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787779629.609815:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c41c716/0x9e63ba8af68894a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.609831:0:6680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c41c716/0x9e63ba8af68894a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.609842:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c41c716/0x9e63ba8af68894a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.609851:0:6680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c41c716/0x9e63ba8af68894a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.609867:0:6680:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787779629.610569:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e852b9ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3307:x1874622525017728:12345-0@lo:6:osp-syn-1-0.0 Request processed in 892us (1254us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1787779629.610578:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1787779629.610659:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1787779629.610696:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98e874222d00/2, rc 0, transno 4294967301 00000100:00100000:3.0:1787779629.610702:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e874222d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622525017728:0@lo:6:osp-syn-1-0.0 00000020:00080000:1.0:1787779629.611496:0:5868:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:1.0:1787779629.611588:0:5868:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00010000:00010000:1.0:1787779629.611605:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787779629.611622:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c41c716/0x9e63ba8af68894a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779629.611635:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87aa67400 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:1.0:1787779629.611640:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c41c716/0x9e63ba8af68894a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779629.611651:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c41c716/0x9e63ba8af68894a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779629.611671:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c41c716/0x9e63ba8af68894a0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779629.611679:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c41c716/0x9e63ba8af68894a0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779629.611759:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779629.611762:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779629.611763:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779629.682939:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779629.727170:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779629.727222:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779629.727256:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779629.727287:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505064960 00000100:00100000:0.0:1787779629.727297:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505064960 00000100:00100000:0.0:1787779629.727379:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 148 00000100:00100000:0.0:1787779629.727389:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e881d80780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54e1e60c-3037-4ae3-b045-838eb9e0ad0b+5:2360:x1874622505064960:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:0.0:1787779629.727477:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e881d80780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54e1e60c-3037-4ae3-b045-838eb9e0ad0b+5:2360:x1874622505064960:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 90us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779629.727485:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 148 00000100:00100000:2.0:1787779629.727891:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505064832 00000100:00100000:2.0:1787779629.727896:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505064832 00000100:00100000:2.0:1787779629.727941:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 81 00000100:00100000:2.0:1787779629.727949:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e881d830c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+7:2360:x1874622505064832:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:2.0:1787779629.727985:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e881d830c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+7:2360:x1874622505064832:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 37us (826us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779629.727992:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 81 00000100:00100000:3.0:1787779629.728131:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505064704 00000100:00100000:3.0:1787779629.728136:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505064704 00000100:00100000:3.0:1787779629.728203:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 294 00000100:00100000:3.0:1787779629.728211:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ebc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+13:2360:x1874622505064704:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:3.0:1787779629.728243:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ebc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+13:2360:x1874622505064704:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 33us (1021us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779629.728250:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 294 00000100:00080000:3.0:1787779629.728282:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787779629.728287:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:1.0:1787779629.875190:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787779629.875200:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787779629.875262:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787779629.875269:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787779629.875405:0:11684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ece43c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11684:1874622525017856:192.168.201.9@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787779629.875488:0:11684:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e845d95b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787779629.880855:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779629.881384:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505065088 00000100:00100000:0.0:1787779629.881404:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505065088 00000100:00100000:0.0:1787779629.881463:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 1 00000100:00100000:0.0:1787779629.881474:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e874223c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+12:10468:x1874622505065088:12345-192.168.201.9@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1787779629.881551:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e874223c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+12:10468:x1874622505065088:12345-192.168.201.9@tcp:900:lhsmtool_posix.0 Request processed in 79us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779629.881558:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 1 00000100:00100000:3.0:1787779629.881835:0:11684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ece43c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11684:1874622525017856:192.168.201.9@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787779629.891402:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779629.891549:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505065216 00000100:00100000:2.0:1787779629.891560:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505065216 00000100:00100000:2.0:1787779629.891628:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 68 00000100:00100000:2.0:1787779629.891638:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e881d80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+11:10468:x1874622505065216:12345-192.168.201.9@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787779629.891673:0:8197:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787779629.891828:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e881d80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+11:10468:x1874622505065216:12345-192.168.201.9@tcp:53:lhsmtool_posix.0 Request processed in 191us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779629.891836:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 68 00000100:00100000:3.0:1787779629.896977:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779629.897076:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505065344 00000100:00100000:2.0:1787779629.897088:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505065344 00000100:00100000:2.0:1787779629.897157:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 69 00000100:00100000:2.0:1787779629.897168:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e852b9e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+11:10468:x1874622505065344:12345-192.168.201.9@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787779629.897256:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67400/0x9e63ba8af68894a7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.897274:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67400/0x9e63ba8af68894a7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.897287:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67400/0x9e63ba8af68894a7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.897358:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67000/0x9e63ba8af68894ae lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.897367:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67000/0x9e63ba8af68894ae lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.897375:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67000/0x9e63ba8af68894ae lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.897415:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66600/0x9e63ba8af68894b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.897425:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66600/0x9e63ba8af68894b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.897432:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66600/0x9e63ba8af68894b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787779629.897469:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787779629.897474:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787779629.897487:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66600/0x9e63ba8af68894b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.897498:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67400/0x9e63ba8af68894a7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.897506:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67400/0x9e63ba8af68894a7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.897513:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67400/0x9e63ba8af68894a7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.897529:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87aa67400 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:2.0:1787779629.897533:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67400/0x9e63ba8af68894a7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.897541:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67400/0x9e63ba8af68894a7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.897554:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98e84927fc00) 00010000:00010000:2.0:1787779629.897557:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787779629.897561:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67400/0x9e63ba8af68894a7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.897568:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67400/0x9e63ba8af68894a7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.897582:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67000/0x9e63ba8af68894ae lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.897588:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67000/0x9e63ba8af68894ae lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.897593:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67000/0x9e63ba8af68894ae lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.897599:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87aa67000 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:2.0:1787779629.897601:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67000/0x9e63ba8af68894ae lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.897608:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67000/0x9e63ba8af68894ae lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.897625:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff98e84927f700) 00010000:00010000:2.0:1787779629.897628:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787779629.897631:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67000/0x9e63ba8af68894ae lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.897637:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67000/0x9e63ba8af68894ae lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.897742:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66600/0x9e63ba8af68894b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.897750:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66600/0x9e63ba8af68894b5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.897756:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66600/0x9e63ba8af68894b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.897761:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87aa66600 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:2.0:1787779629.897765:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66600/0x9e63ba8af68894b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.897771:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66600/0x9e63ba8af68894b5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.897789:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e87450a600) 00010000:00010000:2.0:1787779629.897791:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787779629.897794:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66600/0x9e63ba8af68894b5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.897799:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66600/0x9e63ba8af68894b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779629.897882:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e852b9e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+11:10468:x1874622505065344:12345-192.168.201.9@tcp:34:lhsmtool_posix.0 Request processed in 714us (918us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779629.897890:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 69 00000100:00100000:0.0:1787779629.902945:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779629.903040:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505065600 00000100:00100000:2.0:1787779629.903049:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505065600 00000100:00100000:2.0:1787779629.903108:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 70 00000100:00100000:2.0:1787779629.903119:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e881d82d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+11:10468:x1874622505065600:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787779629.903140:0:8197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779629.903161:0:8197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af68894bc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedad05 expref: -99 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.903263:0:8197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66400/0x9e63ba8af68894c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.903278:0:8197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66400/0x9e63ba8af68894c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.903289:0:8197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66400/0x9e63ba8af68894c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787779629.903300:0:8197:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787779629.903519:0:8197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66400/0x9e63ba8af68894c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.903527:0:8197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66400/0x9e63ba8af68894c3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.903534:0:8197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66400/0x9e63ba8af68894c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.903557:0:8197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87aa66400 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:2.0:1787779629.903562:0:8197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66400/0x9e63ba8af68894c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.903569:0:8197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66400/0x9e63ba8af68894c3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.903581:0:8197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e87450a600) 00010000:00010000:2.0:1787779629.903584:0:8197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787779629.903589:0:8197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66400/0x9e63ba8af68894c3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.903595:0:8197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66400/0x9e63ba8af68894c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.903637:0:8197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af68894bc lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad05 expref: 13 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.903647:0:8197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98e84927fc00) 00010000:00010000:2.0:1787779629.903649:0:8197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787779629.903653:0:8197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af68894bc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad05 expref: 13 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.903662:0:8197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87aa66200, rc 0) 00000100:00100000:2.0:1787779629.903752:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e881d82d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+12:10468:x1874622505065600:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 Request processed in 635us (818us total) trans 4294967351 rc 301/301 00000100:00100000:2.0:1787779629.903761:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 70 00000100:00100000:2.0:1787779629.907884:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779629.908012:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505065728 00000100:00100000:0.0:1787779629.908021:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505065728 00000100:00100000:0.0:1787779629.908080:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 71 00000100:00100000:0.0:1787779629.908090:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e874220b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+12:10468:x1874622505065728:12345-192.168.201.9@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787779629.908126:0:5835:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787779629.908242:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e874220b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+12:10468:x1874622505065728:12345-192.168.201.9@tcp:53:lhsmtool_posix.0 Request processed in 153us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779629.908249:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 71 00000100:00100000:0.0:1787779629.931674:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779629.931912:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505065984 00000100:00100000:2.0:1787779629.931934:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505065984 00000100:00100000:2.0:1787779629.931993:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 72 00000100:00100000:2.0:1787779629.932003:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e881d82580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+12:10468:x1874622505065984:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787779629.932025:0:8197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779629.932028:0:8197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787779629.932056:0:8197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af6889476 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedacf7 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.932076:0:8197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98e87450a200) 00010000:00010000:2.0:1787779629.932082:0:8197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787779629.932095:0:8197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af68894d1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedad0c expref: -99 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787779629.933463:0:8197:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:3.0:1787779629.940109:0:8197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5400/0x9e63ba8af68894d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779629.940134:0:8197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5400/0x9e63ba8af68894d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779629.940147:0:8197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5400/0x9e63ba8af68894d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779629.944356:0:8197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af68894d1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad0c expref: 14 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779629.944410:0:8197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5400/0x9e63ba8af68894d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad0c expref: 13 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779629.944420:0:8197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98e87450a400) 00010000:00010000:3.0:1787779629.944423:0:8197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787779629.944426:0:8197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e8429d5400, rc 0) 00000100:00100000:3.0:1787779629.944492:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e881d82580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+13:10468:x1874622505065984:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 Request processed in 12490us (12827us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1787779629.944502:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 72 00000100:00100000:2.0:1787779629.977963:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779629.978089:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505066240 00000100:00100000:0.0:1787779629.978099:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505066240 00000100:00100000:0.0:1787779629.978158:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 73 00000100:00100000:0.0:1787779629.978173:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e874223480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+13:10468:x1874622505066240:12345-192.168.201.9@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787779629.978235:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787779629.978261:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5400/0x9e63ba8af68894d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad0c expref: 13 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779629.978279:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98e87450a400) 00010000:00010000:0.0:1787779629.978290:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787779629.978311:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af68894e6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779629.978324:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af68894e6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779629.978334:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af68894e6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779629.978384:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af68894ed lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x3f5abea1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779629.978392:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af68894ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x3f5abea1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779629.978399:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af68894ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x3f5abea1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779629.978636:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af68894e6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779629.978644:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af68894e6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779629.978659:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af68894e6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779629.978665:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e848f69200 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:0.0:1787779629.978670:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af68894e6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779629.978677:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af68894e6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779629.978686:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98e87450a200) 00010000:00010000:0.0:1787779629.978689:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787779629.978693:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af68894e6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779629.978699:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af68894e6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779629.978708:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af68894ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x3f5abea1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779629.978745:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af68894ed lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x3f5abea1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779629.978751:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af68894ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x3f5abea1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779629.978756:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e848f68000 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:0.0:1787779629.978759:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af68894ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x3f5abea1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779629.978786:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af68894ed lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x3f5abea1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779629.978794:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x3f5abea1 (ffff98e860e78900) 00010000:00010000:0.0:1787779629.978796:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787779629.978799:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af68894ed lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x3f5abea1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779629.978805:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af68894ed lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x3f5abea1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779629.978893:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e874223480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+12:10468:x1874622505066240:12345-192.168.201.9@tcp:36:lhsmtool_posix.0 Request processed in 720us (938us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787779629.978901:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 73 00000100:00100000:3.0:1787779629.987283:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779629.987412:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505066368 00000100:00100000:2.0:1787779629.987421:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505066368 00000100:00100000:2.0:1787779629.987491:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 74 00000100:00100000:2.0:1787779629.987503:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e852b9de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+12:10468:x1874622505066368:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787779629.987524:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779629.987547:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66600/0x9e63ba8af68894f4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedad13 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.987581:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67000/0x9e63ba8af68894fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.987596:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67000/0x9e63ba8af68894fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.987621:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67000/0x9e63ba8af68894fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.988037:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66600/0x9e63ba8af68894f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad13 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.988058:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67000/0x9e63ba8af68894fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad13 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779629.988066:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98e84927f700) 00010000:00010000:2.0:1787779629.988069:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787779629.988072:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87aa67000, rc 0) 00000100:00100000:2.0:1787779629.988144:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e852b9de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+13:10468:x1874622505066368:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 Request processed in 644us (870us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779629.988152:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 74 00000100:00100000:2.0:1787779629.991246:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779629.991392:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505066624 00000100:00100000:0.0:1787779629.991402:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505066624 00000100:00100000:0.0:1787779629.991461:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 75 00000100:00100000:0.0:1787779629.991470:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e874221a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+13:10468:x1874622505066624:12345-192.168.201.9@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787779629.991564:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af6889502 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779629.991581:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af6889502 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779629.991593:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af6889502 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787779629.991911:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:0.0:1787779629.992332:0:5835:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 395733208090ns, next at 396733205902ns, rc = 0 00000004:00010000:0.0:1787779629.992440:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009a8544cd reply state 00000000c189c4a4 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af6889502 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779629.992450:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787779629.992546:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e874221a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+15:10468:x1874622505066624:12345-192.168.201.9@tcp:36:lhsmtool_posix.0 Request processed in 1076us (1311us total) trans 4294967353 rc 0/0 00000100:00100000:0.0:1787779629.992554:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 75 00010000:00010000:0.0:1787779630.002455:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af6889502 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779630.002473:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af6889502 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779630.002480:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af6889502 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779630.002486:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e848f68000 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:0.0:1787779630.002490:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af6889502 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779630.002498:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af6889502 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779630.002514:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98e84927f700) 00010000:00010000:0.0:1787779630.002518:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787779630.002523:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af6889502 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779630.002530:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af6889502 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779630.010007:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779630.010071:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505066752 00000100:00100000:0.0:1787779630.010080:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505066752 00000100:00100000:0.0:1787779630.010145:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 76 00000100:00100000:0.0:1787779630.010155:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e881d81e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+14:10468:x1874622505066752:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787779630.010180:0:8197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787779630.010201:0:8197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af6889509 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedad1a expref: -99 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779630.010267:0:8197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af6889509 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad1a expref: 15 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779630.010283:0:8197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af6889509 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad1a expref: 15 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779630.010304:0:8197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98e84927f700) 00010000:00010000:0.0:1787779630.010307:0:8197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787779630.010311:0:8197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e848f69200, rc 0) 00000100:00100000:0.0:1787779630.010367:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e881d81e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+15:10468:x1874622505066752:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 Request processed in 213us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779630.010374:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 76 00000100:00080000:0.0:1787779630.010401:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787779630.051986:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779630.052033:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505066880 00000100:00100000:2.0:1787779630.052042:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505066880 00000100:00100000:2.0:1787779630.052086:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 25 00000100:00100000:2.0:1787779630.052095:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e8742221c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2356:x1874622505066880:12345-192.168.201.9@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1787779630.052130:0:6680:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from e225400f-8d32-48a8-ab5e-fe4d3780a20c@192.168.201.9@tcp t0 exp 0000000000000000 cur 395 last 0 00000020:00000080:2.0:1787779630.052168:0:6680:0:(genops.c:1385:class_connect()) connect: client e225400f-8d32-48a8-ab5e-fe4d3780a20c, cookie 0x9e63ba8af6889510 00002000:00100000:2.0:1787779630.052181:0:6680:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e225400f-8d32-48a8-ab5e-fe4d3780a20c/ffff98e881da2800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113939 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787779630.052217:0:6680:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787779630.052502:0:6680:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787779630.052537:0:6680:0:(import.c:65:import_set_state_nolock()) ffff98e881da5800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787779630.052612:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e8742221c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:2356:x1874622505066880:12345-192.168.201.9@tcp:8:lhsmtool_posix.0 Request processed in 516us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779630.052620:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 25 00000100:00100000:1.0:1787779630.059651:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779630.064837:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505067008 00000100:00100000:2.0:1787779630.064854:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505067008 00000100:00100000:2.0:1787779630.064935:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 26 00000100:00100000:2.0:1787779630.064946:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ece6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:0:x1874622505067008:12345-192.168.201.9@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1787779630.068704:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1787779630.141548:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00100000:0.0:1787779630.141564:0:6704:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e225400f-8d32-48a8-ab5e-fe4d3780a20c 00000100:00100000:2.0:1787779630.141766:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ece6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+5:0:x1874622505067008:12345-192.168.201.9@tcp:2:lhsmtool_posix.0 Request processed in 76813us (82117us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1787779630.141791:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 26 00000100:00100000:0.0:1787779630.152376:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779630.162791:0:11475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505067264 00000100:00100000:1.0:1787779630.162805:0:11475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505067264 00000100:00100000:0.0:1787779630.163072:0:11475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 19 00000100:00100000:0.0:1787779630.163084:0:11475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e881d80b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+15:10468:x1874622505067264:12345-192.168.201.9@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787779630.163355:0:11475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e881d80b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+16:10468:x1874622505067264:12345-192.168.201.9@tcp:35:lhsmtool_posix.0 Request processed in 272us (10984us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1787779630.163363:0:11475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 19 00000100:00100000:0.0:1787779630.167947:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779630.168156:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505067520 00000100:00100000:3.0:1787779630.168166:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505067520 00000100:00100000:3.0:1787779630.168235:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 77 00000100:00100000:3.0:1787779630.168245:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e31e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+16:10468:x1874622505067520:12345-192.168.201.9@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787779630.168351:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e31e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+16:10468:x1874622505067520:12345-192.168.201.9@tcp:57:lhsmtool_posix.0 Request processed in 107us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779630.168358:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 77 00000100:00100000:1.0:1787779630.177786:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779630.178644:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505067648 00000100:00100000:3.0:1787779630.178654:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505067648 00000100:00100000:3.0:1787779630.178886:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 78 00000100:00100000:3.0:1787779630.178898:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ece7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+16:10468:x1874622505067648:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787779630.178922:0:8197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779630.178942:0:8197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5800/0x9e63ba8af6889517 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedad21 expref: -99 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779630.179034:0:8197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af688951e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779630.179049:0:8197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af688951e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779630.179062:0:8197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af688951e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787779630.179100:0:8197:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787779630.179120:0:8197:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af688951e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779630.179146:0:8197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5800/0x9e63ba8af6889517 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad21 expref: 18 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779630.179163:0:8197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af688951e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad21 expref: 17 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779630.179171:0:8197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98e84927f700) 00010000:00010000:3.0:1787779630.179175:0:8197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787779630.179179:0:8197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e8429d5c00, rc 0) 00000100:00100000:3.0:1787779630.179253:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ece7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+17:10468:x1874622505067648:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 Request processed in 358us (1490us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779630.179261:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 78 00000100:00100000:0.0:1787779630.197298:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779630.197431:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505067776 00000100:00100000:2.0:1787779630.197441:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505067776 00000100:00100000:2.0:1787779630.197503:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 27 00000100:00100000:2.0:1787779630.197513:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e33c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+5:2359:x1874622505067776:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787779630.197532:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779630.197554:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000031011311/0x9e63ba8af6889525 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedad28 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787779630.197594:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8f5a2d, blocks: 0x1 00010000:00010000:2.0:1787779630.197616:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=395s v=(0 0) 00010000:00010000:2.0:1787779630.197620:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787779630.197630:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000031011311/0x9e63ba8af6889525 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad28 expref: 6 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779630.197651:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000031011311/0x9e63ba8af6889525 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad28 expref: 6 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779630.197676:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87aa66600, rc 0) 00000100:00100000:2.0:1787779630.197762:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e33c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:2359:x1874622505067776:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 Request processed in 250us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779630.197782:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 27 00000100:00100000:0.0:1787779630.205396:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779630.206419:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505068032 00000100:00100000:3.0:1787779630.206430:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505068032 00000100:00100000:3.0:1787779630.206498:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 79 00000100:00100000:3.0:1787779630.206521:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e30b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+17:10468:x1874622505068032:12345-192.168.201.9@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787779630.206650:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e30b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+17:10468:x1874622505068032:12345-192.168.201.9@tcp:57:lhsmtool_posix.0 Request processed in 130us (1264us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779630.206658:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 79 00000100:00100000:0.0:1787779630.241850:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779630.247144:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505068160 00000100:00100000:2.0:1787779630.247157:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505068160 00000100:00100000:2.0:1787779630.247223:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 28 00000100:00100000:2.0:1787779630.247234:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:10468:x1874622505068160:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787779630.247251:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779630.247270:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004a4d0f41/0x9e63ba8af688952c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedad2f expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779630.247303:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000031011311/0x9e63ba8af6889525 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad28 expref: 7 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779630.247313:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787779630.247317:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787779630.247323:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a4d0f41/0x9e63ba8af688952c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad2f expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779630.247355:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000031011311/0x9e63ba8af6889525 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad28 expref: 7 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779630.247368:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000031011311/0x9e63ba8af6889525 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad28 expref: 7 pid: 6680 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779630.247403:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e8742203c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6681:1874622525017984:192.168.201.9@tcp:104: 00000100:00100000:2.0:1787779630.247505:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e8521e0600 going to sleep for 11 seconds 00000100:00100000:1.0:1787779630.258914:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e8742203c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6681:1874622525017984:192.168.201.9@tcp:104: 00010000:00010000:1.0:1787779630.258953:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004a4d0f41/0x9e63ba8af688952c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad2f expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779630.258978:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87aa67600, rc 0) 00000100:00100000:1.0:1787779630.259040:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+7:10468:x1874622505068160:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 Request processed in 11808us (17201us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779630.259050:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 28 00000100:00100000:1.0:1787779630.292299:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779630.294752:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505068288 00000100:00100000:3.0:1787779630.294776:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505068288 00010000:00010000:3.0:1787779630.294834:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000031011311/0x9e63ba8af6889525 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad28 expref: 7 pid: 6680 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779630.294881:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 42 00000100:00100000:3.0:1787779630.294891:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e847d96850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+7:2359:x1874622505068288:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787779630.294909:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787779630.294938:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: 0000000031011311/0x9e63ba8af6889525 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad28 expref: 7 pid: 6680 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779630.294955:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000031011311/0x9e63ba8af6889525 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad28 expref: 7 pid: 6680 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779630.294995:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000031011311/0x9e63ba8af6889525 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad28 expref: 7 pid: 6680 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779630.295010:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787779630.295014:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787779630.295023:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004a4d0f41/0x9e63ba8af688952c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad2f expref: 6 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779630.295048:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a4d0f41/0x9e63ba8af688952c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad2f expref: 6 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779630.295094:0:5823:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000004a4d0f41/0x9e63ba8af688952c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad2f expref: 6 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779630.295109:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e852b9fc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5823:1874622525018112:192.168.201.9@tcp:105: 00000100:00100000:3.0:1787779630.295201:0:5823:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e87f036540 going to sleep for 11 seconds 00000100:00100000:0.0:1787779630.303027:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779630.303128:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505068416 00000100:00100000:2.0:1787779630.303141:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505068416 00002000:00100000:2.0:1787779630.303201:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff98e842e31a40 x1874622505068416/t0(0) o4->e225400f-8d32-48a8-ab5e-fe4d3780a20c@192.168.201.9@tcp:41/0 lens 504/0 e 0 to 0 dl 1787779641 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787779630.303214:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98e842e31a40 with x1874622505068416 ext(0->8) 00002000:00010000:2.0:1787779630.303220:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98e842e31a40 00000100:00100000:2.0:1787779630.303259:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 0 00000100:00100000:2.0:1787779630.303270:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e31a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+7:2360:x1874622505068416:12345-192.168.201.9@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787779630.303996:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e31a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+9:2360:x1874622505068416:12345-192.168.201.9@tcp:4:lhsmtool_posix.0 Request processed in 726us (979us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1787779630.304006:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 0 00002000:00100000:2.0:1787779630.304014:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff98e842e31a40 x1874622505068416/t4294967302(0) o4->e225400f-8d32-48a8-ab5e-fe4d3780a20c@192.168.201.9@tcp:41/0 lens 504/448 e 0 to 0 dl 1787779641 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787779630.304023:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98e842e31a40 with x1874622505068416 ext(0->8) 00002000:00010000:2.0:1787779630.304027:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98e842e31a40 00000100:00100000:3.0:1787779630.304445:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e852b9fc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5823:1874622525018112:192.168.201.9@tcp:105: 00010000:00010000:3.0:1787779630.304470:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787779630.304516:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e847d96850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+8:2359:x1874622505068288:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 9627us (12229us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779630.304527:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 42 00000100:00100000:0.0:1787779630.314696:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779630.314866:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505068544 00000100:00100000:3.0:1787779630.314878:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505068544 00000100:00100000:3.0:1787779630.314954:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 80 00000100:00100000:3.0:1787779630.314967:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e321c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+17:10468:x1874622505068544:12345-192.168.201.9@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787779630.447897:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:0.0:1787779630.447926:0:5857:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:0.0:1787779630.447938:0:5857:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000100:00100000:3.0:1787779630.448469:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e321c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+13:10468:x1874622505068544:12345-192.168.201.9@tcp:44:lhsmtool_posix.0 Request processed in 133499us (133781us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779630.448480:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 80 00000100:00100000:3.0:1787779630.449030:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787779630.449047:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e852b9fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874622525018240:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787779630.449094:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779630.449164:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525018240 00000100:00100000:3.0:1787779630.449171:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525018240 00000100:00100000:3.0:1787779630.450241:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787779630.450252:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e852b9cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874622525018240:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1787779630.450674:0:6680:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787779630.450678:0:6680:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787779629 00002000:00010000:3.0:1787779630.450681:0:6680:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787779630.450683:0:6680:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787779629 -> 1787779629 00002000:00010000:3.0:1787779630.450685:0:6680:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1787779630.450759:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e852b9cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1874622525018240:12345-0@lo:2:osp-syn-0-0.0 Request processed in 508us (1663us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1787779630.450781:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1787779630.450807:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1787779630.450843:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98e852b9fc00/2, rc 0, transno 4294967303 00000100:00100000:3.0:1787779630.450850:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e852b9fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874622525018240:0@lo:2:osp-syn-0-0.0 00000020:00080000:1.0:1787779630.451226:0:5868:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:1.0:1787779630.451240:0:5868:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1787779630.454029:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779630.454136:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505068672 00000100:00100000:1.0:1787779630.454146:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505068672 00000100:00100000:1.0:1787779630.454207:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 30 00000100:00100000:1.0:1787779630.454216:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e881a68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+8:2359:x1874622505068672:12345-192.168.201.9@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1787779630.568834:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:0.0:1787779630.568860:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:2.0:1787779630.570050:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e881a68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:2359:x1874622505068672:12345-192.168.201.9@tcp:16:lhsmtool_posix.0 Request processed in 115826us (116022us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779630.570063:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 30 00000100:00100000:3.0:1787779630.576187:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779630.576345:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505068928 00000100:00100000:1.0:1787779630.576355:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505068928 00000100:00100000:1.0:1787779630.576427:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 81 00000100:00100000:1.0:1787779630.576437:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e852b9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+13:10468:x1874622505068928:12345-192.168.201.9@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787779630.576490:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787779630.576549:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af688951e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad21 expref: 13 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779630.576568:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98e84927f700) 00010000:00010000:1.0:1787779630.576575:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787779630.576621:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af6889533 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779630.576635:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af6889533 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779630.576644:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af6889533 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787779630.576979:0:5836:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000c0cbae5 reply state 0000000024156978 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af6889533 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779630.576990:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787779630.577088:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e852b9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+14:10468:x1874622505068928:12345-192.168.201.9@tcp:36:lhsmtool_posix.0 Request processed in 653us (922us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1787779630.577096:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 81 00010000:00010000:3.0:1787779630.580349:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af6889533 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779630.580368:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af6889533 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779630.580375:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af6889533 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779630.580382:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87a98b600 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:3.0:1787779630.580387:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af6889533 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779630.580395:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af6889533 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779630.580429:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98e84927f700) 00010000:00010000:3.0:1787779630.580431:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779630.580436:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af6889533 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779630.580443:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af6889533 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779630.585917:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779630.586134:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505069056 00000100:00100000:3.0:1787779630.586145:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505069056 00000100:00100000:3.0:1787779630.586212:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 31 00000100:00100000:3.0:1787779630.586223:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e874223840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:2357:x1874622505069056:12345-192.168.201.9@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787779630.586481:0:6680:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1787779630.586484:0:6680:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1787779629 -> 1787779628 00002000:00010000:3.0:1787779630.586487:0:6680:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787779626 00002000:00010000:3.0:1787779630.586489:0:6680:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787779629 -> 1787779628 00002000:00010000:3.0:1787779630.586491:0:6680:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1787779630.586559:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e874223840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+7:2357:x1874622505069056:12345-192.168.201.9@tcp:2:lhsmtool_posix.0 Request processed in 337us (649us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1787779630.586567:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 31 00000100:00100000:0.0:1787779630.600591:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779630.600842:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505069312 00000100:00100000:3.0:1787779630.600851:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505069312 00000100:00100000:3.0:1787779630.600907:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 82 00000100:00100000:3.0:1787779630.600929:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e303c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+13:10468:x1874622505069312:12345-192.168.201.9@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787779630.601002:0:8197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5800/0x9e63ba8af688953a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779630.601037:0:8197:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67000/0x9e63ba8af68894fb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad13 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779630.601046:0:8197:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5800/0x9e63ba8af688953a lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779630.601082:0:8197:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67000/0x9e63ba8af68894fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad13 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779630.601095:0:8197:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67000/0x9e63ba8af68894fb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad13 expref: 13 pid: 5837 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779630.601108:0:8197:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e852b9da40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8197:1874622525018368:192.168.201.9@tcp:104: 00000100:00100000:3.0:1787779630.601485:0:8197:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e87f036780 going to sleep for 11 seconds 00000100:00100000:0.0:1787779630.617434:0:8197:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e852b9da40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8197:1874622525018368:192.168.201.9@tcp:104: 00010000:00010000:0.0:1787779630.617466:0:8197:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5800/0x9e63ba8af688953a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779630.618453:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779630.619390:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505069440 00000100:00100000:3.0:1787779630.619399:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505069440 00010000:00010000:3.0:1787779630.619441:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67000/0x9e63ba8af68894fb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad13 expref: 14 pid: 5837 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779630.619476:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 43 00000100:00100000:3.0:1787779630.619487:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e30f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+14:2360:x1874622505069440:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787779630.619518:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787779630.619545:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67000/0x9e63ba8af68894fb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad13 expref: 14 pid: 5837 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779630.619558:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67000/0x9e63ba8af68894fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad13 expref: 14 pid: 5837 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779630.619587:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67000/0x9e63ba8af68894fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad13 expref: 14 pid: 5837 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779630.619779:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98e84927f700) 00010000:00010000:2.0:1787779630.619785:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5800/0x9e63ba8af688953a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779630.619795:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5800/0x9e63ba8af688953a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779630.619803:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5800/0x9e63ba8af688953a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779630.619853:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787779630.619921:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e30f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+13:2360:x1874622505069440:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 437us (1471us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779630.619930:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 43 00010000:00010000:3.0:1787779630.621076:0:8197:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5800/0x9e63ba8af688953a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779630.621088:0:8197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5800/0x9e63ba8af688953a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779630.621126:0:8197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5800/0x9e63ba8af688953a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779630.621133:0:8197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5800/0x9e63ba8af688953a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779630.621139:0:8197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5800/0x9e63ba8af688953a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779630.621145:0:8197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e8429d5800 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:3.0:1787779630.621149:0:8197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5800/0x9e63ba8af688953a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779630.621157:0:8197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5800/0x9e63ba8af688953a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779630.621169:0:8197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98e84927f700) 00010000:00010000:3.0:1787779630.621172:0:8197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787779630.621176:0:8197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5800/0x9e63ba8af688953a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779630.621182:0:8197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5800/0x9e63ba8af688953a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779630.621256:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e303c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+12:10468:x1874622505069312:12345-192.168.201.9@tcp:55:lhsmtool_posix.0 Request processed in 20327us (20672us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787779630.621266:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 82 00000100:00100000:3.0:1787779630.631901:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779630.637086:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505069568 00000100:00100000:3.0:1787779630.637101:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505069568 00000100:00100000:3.0:1787779630.637185:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 32 00000100:00100000:3.0:1787779630.637206:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e852b9e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+7:2357:x1874622505069568:12345-192.168.201.9@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787779630.637250:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a99c53bd/0x9e63ba8af6889541 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779630.637270:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004a4d0f41/0x9e63ba8af688952c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad2f expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779630.637278:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787779630.637282:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787779630.637287:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a99c53bd/0x9e63ba8af6889541 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779630.637321:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004a4d0f41/0x9e63ba8af688952c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad2f expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779630.637335:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004a4d0f41/0x9e63ba8af688952c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad2f expref: 7 pid: 6681 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779630.637349:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e852b9c3c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6681:1874622525018496:192.168.201.9@tcp:104: 00000100:00100000:3.0:1787779630.637432:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e87f036d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787779630.649826:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e852b9c3c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6681:1874622525018496:192.168.201.9@tcp:104: 00000100:00100000:1.0:1787779630.649826:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00010000:00010000:3.0:1787779630.649852:0:6681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a99c53bd/0x9e63ba8af6889541 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779630.652092:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505069696 00000100:00100000:0.0:1787779630.652104:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505069696 00010000:00010000:0.0:1787779630.652148:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004a4d0f41/0x9e63ba8af688952c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad2f expref: 8 pid: 6681 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779630.658539:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 44 00000100:00100000:0.0:1787779630.658578:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ece6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+8:2359:x1874622505069696:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787779630.658599:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787779630.658626:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004a4d0f41/0x9e63ba8af688952c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad2f expref: 8 pid: 6681 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779630.658644:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004a4d0f41/0x9e63ba8af688952c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad2f expref: 8 pid: 6681 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779630.658669:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a4d0f41/0x9e63ba8af688952c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad2f expref: 8 pid: 6681 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779630.658687:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787779630.658691:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787779630.658696:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a99c53bd/0x9e63ba8af6889541 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779630.658706:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a99c53bd/0x9e63ba8af6889541 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779630.658769:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787779630.658838:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ece6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+7:2359:x1874622505069696:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 270us (9018us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779630.658846:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 44 00010000:00010000:2.0:1787779630.661997:0:6681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a99c53bd/0x9e63ba8af6889541 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779630.662017:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a99c53bd/0x9e63ba8af6889541 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779630.662075:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a99c53bd/0x9e63ba8af6889541 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779630.662083:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a99c53bd/0x9e63ba8af6889541 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779630.662092:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a99c53bd/0x9e63ba8af6889541 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779630.662099:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e8429d5200 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:2.0:1787779630.662104:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a99c53bd/0x9e63ba8af6889541 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779630.662113:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a99c53bd/0x9e63ba8af6889541 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779630.662132:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a99c53bd/0x9e63ba8af6889541 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779630.662140:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a99c53bd/0x9e63ba8af6889541 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779630.662236:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e852b9e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:2357:x1874622505069568:12345-192.168.201.9@tcp:1:lhsmtool_posix.0 Request processed in 25038us (30342us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779630.662246:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 32 00000100:00100000:3.0:1787779630.676307:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779630.676360:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505069952 00000100:00100000:3.0:1787779630.676370:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505069952 00000100:00100000:3.0:1787779630.676422:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 83 00000100:00100000:3.0:1787779630.676431:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e852b9c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+12:10468:x1874622505069952:12345-192.168.201.9@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787779630.676503:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5800/0x9e63ba8af6889548 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779630.676520:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5800/0x9e63ba8af6889548 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779630.676531:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5800/0x9e63ba8af6889548 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779630.676770:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af688954f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779630.676783:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af6889509 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad1a expref: 13 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779630.676791:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af688954f lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779630.676825:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af6889509 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad1a expref: 13 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779630.676839:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af6889509 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad1a expref: 13 pid: 8197 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779630.676854:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e852b9cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5835:1874622525018624:192.168.201.9@tcp:104: 00000100:00100000:3.0:1787779630.676929:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e87f036d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787779630.685929:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e852b9cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5835:1874622525018624:192.168.201.9@tcp:104: 00010000:00010000:3.0:1787779630.685970:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af688954f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779630.694027:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779630.694068:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505070080 00000100:00100000:2.0:1787779630.694077:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505070080 00010000:00010000:2.0:1787779630.694117:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af6889509 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad1a expref: 14 pid: 8197 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779630.694151:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 45 00000100:00100000:2.0:1787779630.694160:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e8742221c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+14:2360:x1874622505070080:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787779630.694174:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787779630.694182:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af6889509 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad1a expref: 14 pid: 8197 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779630.694195:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af6889509 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad1a expref: 14 pid: 8197 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779630.694218:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af6889509 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad1a expref: 14 pid: 8197 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779630.694232:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98e84927f700) 00010000:00010000:2.0:1787779630.694237:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af688954f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779630.694247:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af688954f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779630.694255:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af688954f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779630.694288:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787779630.694344:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e8742221c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+13:2360:x1874622505070080:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 184us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779630.694353:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 45 00010000:00010000:3.0:1787779630.696350:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af688954f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779630.696365:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af688954f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787779630.696576:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:3.0:1787779630.696775:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:3.0:1787779630.696824:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:3.0:1787779630.697146:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e852b9cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5835:1874622525018752:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787779630.697265:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779630.697304:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e847279840 going to sleep for 11 seconds 00000100:00100000:0.0:1787779630.697370:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525018752 00000100:00100000:0.0:1787779630.697388:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525018752 00000100:00100000:0.0:1787779630.697440:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787779630.697449:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e852b9d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5835:x1874622525018752:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787779630.697537:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e852b9d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5835:x1874622525018752:12345-0@lo:1000:mdt00_000.0 Request processed in 88us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779630.697544:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787779630.697661:0:5835:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:3.0:1787779630.697666:0:5835:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98e852b9fc00, transno 4294967303 00000100:00100000:3.0:1787779630.697689:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e852b9cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5835:1874622525018752:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1787779630.702374:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:3.0:1787779630.702480:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e852b9cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5835:1874622525018880:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787779630.702547:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779630.702593:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e87f036d80 going to sleep for 11 seconds 00010000:00010000:2.0:1787779630.709938:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779630.710650:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525018880 00000100:00100000:1.0:1787779630.710662:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525018880 00000100:00100000:1.0:1787779630.710744:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787779630.710754:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e852b9d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5835:x1874622525018880:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787779630.711077:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e852b9d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5835:x1874622525018880:12345-0@lo:1000:mdt00_000.0 Request processed in 325us (8530us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1787779630.711085:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787779630.711233:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e852b9cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5835:1874622525018880:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1787779630.711275:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af688954f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779630.711284:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af688954f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779630.711308:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af688954f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779630.711314:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e8429d4e00 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:3.0:1787779630.711318:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af688954f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779630.711325:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af688954f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779630.711340:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98e84927f700) 00010000:00010000:3.0:1787779630.711343:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787779630.711348:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af688954f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779630.711353:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af688954f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779630.711399:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af688947d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779630.711405:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af688947d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779630.711411:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af688947d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779630.711415:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e8429d5000 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:3.0:1787779630.711418:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af688947d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779630.711432:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af688947d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779630.711440:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e87450a600) 00010000:00010000:3.0:1787779630.711442:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787779630.711445:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af688947d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779630.711450:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af688947d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779630.711474:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5200/0x9e63ba8af6889556 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779630.711489:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af6889499 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedacfe expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779630.711498:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5200/0x9e63ba8af6889556 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779630.711531:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af6889499 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedacfe expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779630.711545:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af6889499 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedacfe expref: 16 pid: 5837 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779630.711558:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e852b9e940 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5835:1874622525019008:192.168.201.9@tcp:104: 00000100:00100000:3.0:1787779630.711642:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e87f036d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787779630.716180:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e852b9e940 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5835:1874622525019008:192.168.201.9@tcp:104: 00010000:00010000:3.0:1787779630.716226:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5200/0x9e63ba8af6889556 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779630.716362:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779630.717045:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505070208 00000100:00100000:3.0:1787779630.717054:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505070208 00010000:00010000:3.0:1787779630.717087:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af6889499 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedacfe expref: 17 pid: 5837 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779630.717123:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 46 00000100:00100000:3.0:1787779630.717132:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87aa30b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+17:2359:x1874622505070208:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787779630.717146:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787779630.717153:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af6889499 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedacfe expref: 17 pid: 5837 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779630.717165:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af6889499 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedacfe expref: 17 pid: 5837 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779630.717186:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af6889499 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedacfe expref: 17 pid: 5837 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779630.717201:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e87450a600) 00010000:00010000:3.0:1787779630.717206:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5200/0x9e63ba8af6889556 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779630.717216:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5200/0x9e63ba8af6889556 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779630.717223:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5200/0x9e63ba8af6889556 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779630.717259:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787779630.717311:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87aa30b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+16:2359:x1874622505070208:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 180us (950us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779630.717319:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 46 00010000:00010000:2.0:1787779630.717875:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5200/0x9e63ba8af6889556 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779630.717884:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5200/0x9e63ba8af6889556 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779630.717896:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5200/0x9e63ba8af6889556 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779630.717902:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5200/0x9e63ba8af6889556 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779630.717908:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5200/0x9e63ba8af6889556 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779630.717914:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e8429d5200 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:2.0:1787779630.717918:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5200/0x9e63ba8af6889556 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779630.717926:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5200/0x9e63ba8af6889556 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779630.717936:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e87450a600) 00010000:00010000:2.0:1787779630.717939:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787779630.717943:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5200/0x9e63ba8af6889556 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779630.717949:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5200/0x9e63ba8af6889556 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779630.717980:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5800/0x9e63ba8af6889548 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779630.717987:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5800/0x9e63ba8af6889548 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779630.717993:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5800/0x9e63ba8af6889548 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779630.717999:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e8429d5800 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:2.0:1787779630.718002:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5800/0x9e63ba8af6889548 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779630.718008:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5800/0x9e63ba8af6889548 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779630.718016:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e87450a600) 00010000:00010000:2.0:1787779630.718018:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787779630.718020:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5800/0x9e63ba8af6889548 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779630.718026:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5800/0x9e63ba8af6889548 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779630.718249:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e852b9c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+15:10468:x1874622505069952:12345-192.168.201.9@tcp:57:lhsmtool_posix.0 Request processed in 41818us (41950us total) trans 4294967360 rc 0/0 00000100:00100000:2.0:1787779630.718259:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 83 00000020:00080000:2.0:1787779630.718262:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1787779630.735411:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779630.735486:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505070464 00000100:00100000:2.0:1787779630.735496:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505070464 00000100:00100000:2.0:1787779630.735563:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 20 00000100:00100000:2.0:1787779630.735572:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87aa30780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+15:10468:x1874622505070464:12345-192.168.201.9@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787779630.736250:0:5839:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787779630.736353:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:2.0:1787779630.736398:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af688955d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779630.736416:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af688955d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779630.736427:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af688955d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779630.736435:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af688955d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779630.736442:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af688955d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779630.736448:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af688955d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779630.736464:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787779630.736554:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87aa30780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+17:10468:x1874622505070464:12345-192.168.201.9@tcp:35:lhsmtool_posix.0 Request processed in 980us (1150us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1787779630.736563:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 20 00000020:00080000:2.0:1787779630.736569:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787779630.742113:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787779630.742128:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af688955d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779630.742140:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87aa67e00 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:1.0:1787779630.742161:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af688955d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779630.742172:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af688955d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779630.742192:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98e84927fb00) 00010000:00010000:1.0:1787779630.742195:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787779630.742199:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af688955d lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779630.742207:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af688955d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779630.742240:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779630.742241:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779630.742243:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787779630.743081:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787779630.743088:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787779630.743121:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1787779630.743129:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1787779630.923329:0:11993:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787779630.923338:0:11993:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787779630.923387:0:11993:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1787779630.923395:0:11993:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787779631.204812:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779631.206503:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505070720 00000100:00100000:0.0:1787779631.206515:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505070720 00000100:00100000:0.0:1787779631.206614:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 84 00000100:00100000:0.0:1787779631.206624:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e874220f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+17:10477:x1874622505070720:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:0.0:1787779631.206649:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787779631.206670:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68a00/0x9e63ba8af6889564 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedad36 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779631.207085:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69e00/0x9e63ba8af688956b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779631.207100:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69e00/0x9e63ba8af688956b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779631.213269:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69e00/0x9e63ba8af688956b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787779631.213305:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:0.0:1787779631.213648:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68a00/0x9e63ba8af6889564 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad36 expref: 20 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779631.213669:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69e00/0x9e63ba8af688956b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad36 expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779631.213679:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98e87450a200) 00010000:00010000:0.0:1787779631.213682:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787779631.213692:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e848f69e00, rc 0) 00000100:00100000:0.0:1787779631.213797:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e874220f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+19:10477:x1874622505070720:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 7173us (8993us total) trans 4294967363 rc 0/0 00000100:00100000:0.0:1787779631.213807:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 84 00000100:00100000:2.0:1787779631.217058:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779631.218175:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505070848 00000100:00100000:3.0:1787779631.218197:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505070848 00000100:00100000:3.0:1787779631.218256:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 85 00000100:00100000:3.0:1787779631.218266:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e8742203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+19:10477:x1874622505070848:12345-192.168.201.9@tcp:34:lfs.0 00010000:00010000:3.0:1787779631.218339:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af6889579 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.218357:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af6889579 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.218381:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af6889579 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.218440:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af6889580 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.218448:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af6889580 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.218461:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af6889580 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.218777:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af6889587 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.218786:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af6889587 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.218794:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af6889587 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787779631.218838:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af6889587 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.218852:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af6889579 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.218859:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af6889579 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.218865:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af6889579 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.218872:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e8429d4000 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:3.0:1787779631.218877:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af6889579 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.218884:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af6889579 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.218897:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98e87450a200) 00010000:00010000:3.0:1787779631.218917:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779631.218924:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af6889579 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.218931:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af6889579 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.218948:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af6889580 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.218954:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af6889580 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.218960:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af6889580 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.218965:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e8429d5000 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:3.0:1787779631.218968:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af6889580 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.218974:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af6889580 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.218982:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98e87450a000) 00010000:00010000:3.0:1787779631.218984:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779631.218987:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af6889580 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.218993:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af6889580 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.219009:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af6889587 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.219020:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af6889587 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.219026:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af6889587 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.219031:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e8429d4e00 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:3.0:1787779631.219034:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af6889587 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.219040:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af6889587 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.219048:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e87450ad00) 00010000:00010000:3.0:1787779631.219050:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779631.219054:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af6889587 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.219059:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af6889587 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779631.219173:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e8742203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+19:10477:x1874622505070848:12345-192.168.201.9@tcp:34:lfs.0 Request processed in 906us (2123us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779631.219183:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 85 00000100:00100000:0.0:1787779631.297736:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779631.298666:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505071104 00000100:00100000:3.0:1787779631.298679:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505071104 00000100:00100000:3.0:1787779631.298763:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 86 00000100:00100000:3.0:1787779631.298774:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e31680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+19:10481:x1874622505071104:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:3.0:1787779631.298798:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779631.298836:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af688958e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedad3d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.298919:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af6889595 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.298934:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af6889595 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.298947:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af6889595 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.298962:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af688959c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.298970:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af688959c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.298977:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af688959c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.299303:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af68895a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.299312:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af68895a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.299319:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af68895a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787779631.299330:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1787779631.299581:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af6889595 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.299599:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af6889595 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.299606:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af6889595 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.299613:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e8429d5000 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:3.0:1787779631.299618:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af6889595 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.299626:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af6889595 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.299641:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98e87450a200) 00010000:00010000:3.0:1787779631.299643:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779631.299648:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af6889595 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.299655:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af6889595 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.299668:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af688959c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.299674:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af688959c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.299680:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af688959c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.299686:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e8429d4000 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:3.0:1787779631.299696:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af688959c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.299702:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af688959c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.299727:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98e87450ad00) 00010000:00010000:3.0:1787779631.299730:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779631.299734:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af688959c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.299740:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af688959c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.299797:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af688958e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad3d expref: 22 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.299812:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af68895a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad3d expref: 21 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.299819:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e87450a000) 00010000:00010000:3.0:1787779631.299821:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787779631.299824:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e8429d4400, rc 0) 00000100:00100000:3.0:1787779631.299891:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e31680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+21:10481:x1874622505071104:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 1118us (2194us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1787779631.299899:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 86 00000100:00100000:1.0:1787779631.302673:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779631.303842:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505071232 00000100:00100000:3.0:1787779631.303853:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505071232 00000100:00100000:3.0:1787779631.303911:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 87 00000100:00100000:3.0:1787779631.303921:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87aa330c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+21:10481:x1874622505071232:12345-192.168.201.9@tcp:54:lfs.0 00010000:00010000:3.0:1787779631.304003:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af68895b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.304021:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af68895b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.304034:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af68895b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.304065:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af68895b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.304072:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af68895b1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.304079:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af68895b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.304085:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e8429d5c00 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:3.0:1787779631.304088:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af68895b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.304095:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af68895b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.304107:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e87450a000) 00010000:00010000:3.0:1787779631.304110:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787779631.304114:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af68895b1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.304119:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af68895b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779631.304197:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87aa330c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+21:10481:x1874622505071232:12345-192.168.201.9@tcp:54:lfs.0 Request processed in 277us (1532us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779631.304204:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 87 00000100:00100000:0.0:1787779631.321088:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779631.334486:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505071488 00000100:00100000:1.0:1787779631.334504:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505071488 00000100:00100000:1.0:1787779631.334610:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 21 00000100:00100000:1.0:1787779631.334621:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e86c75bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+21:10481:x1874622505071488:12345-192.168.201.9@tcp:35:lfs.0 00000100:00100000:1.0:1787779631.334913:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e86c75bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+22:10481:x1874622505071488:12345-192.168.201.9@tcp:35:lfs.0 Request processed in 294us (13833us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1787779631.334922:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 21 00000100:00100000:0.0:1787779631.440998:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779631.441189:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505071744 00000100:00100000:2.0:1787779631.441200:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505071744 00000100:00100000:2.0:1787779631.441277:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 88 00000100:00100000:2.0:1787779631.441287:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e312c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+22:10009:x1874622505071744:12345-192.168.201.9@tcp:101:bash.0 00010000:00010000:2.0:1787779631.441314:0:8197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779631.441337:0:8197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66a00/0x9e63ba8af68895b8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedad44 expref: -99 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779631.441450:0:8197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67a00/0x9e63ba8af68895bf lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779631.441467:0:8197:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af68895a3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad3d expref: 23 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779631.441478:0:8197:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67a00/0x9e63ba8af68895bf lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779631.441515:0:8197:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af68895a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad3d expref: 23 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779631.441528:0:8197:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af68895a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad3d expref: 23 pid: 5837 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779631.441542:0:8197:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e874221680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8197:1874622525019136:192.168.201.9@tcp:104: 00000100:00100000:2.0:1787779631.441642:0:8197:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e8521e0480 going to sleep for 11 seconds 00000100:00100000:1.0:1787779631.444502:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779631.444935:0:8197:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e874221680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8197:1874622525019136:192.168.201.9@tcp:104: 00010000:00010000:2.0:1787779631.444964:0:8197:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67a00/0x9e63ba8af68895bf lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779631.445865:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505071872 00000100:00100000:3.0:1787779631.445873:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505071872 00010000:00010000:3.0:1787779631.445920:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af68895a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad3d expref: 24 pid: 5837 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779631.445965:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 47 00000100:00100000:3.0:1787779631.445974:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87aa30780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+24:2360:x1874622505071872:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787779631.445993:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787779631.446000:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af68895a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad3d expref: 24 pid: 5837 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.446013:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af68895a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad3d expref: 24 pid: 5837 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.446040:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af68895a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad3d expref: 24 pid: 5837 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.446060:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e87450a000) 00010000:00010000:3.0:1787779631.446064:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67a00/0x9e63ba8af68895bf lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.446074:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67a00/0x9e63ba8af68895bf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.446100:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67a00/0x9e63ba8af68895bf lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.446131:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787779631.446198:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87aa30780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+23:2360:x1874622505071872:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 225us (1705us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779631.446207:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 47 00010000:00010000:2.0:1787779631.446916:0:8197:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67a00/0x9e63ba8af68895bf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779631.446934:0:8197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67a00/0x9e63ba8af68895bf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787779631.446977:0:8197:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1787779631.447123:0:8197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66a00/0x9e63ba8af68895b8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad44 expref: 24 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779631.447141:0:8197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67a00/0x9e63ba8af68895bf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad44 expref: 23 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779631.447149:0:8197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e87450a000) 00010000:00010000:2.0:1787779631.447152:0:8197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787779631.447154:0:8197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87aa67a00, rc 0) 00000100:00100000:2.0:1787779631.447198:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e312c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+23:10009:x1874622505071744:12345-192.168.201.9@tcp:101:bash.0 Request processed in 5912us (6213us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1787779631.447206:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 88 00000100:00100000:1.0:1787779631.449820:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779631.449915:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505072128 00000100:00100000:0.0:1787779631.449925:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505072128 00000100:00100000:0.0:1787779631.449978:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 89 00000100:00100000:0.0:1787779631.449988:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f53b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+23:10009:x1874622505072128:12345-192.168.201.9@tcp:36:bash.0 00010000:00010000:0.0:1787779631.450229:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68a00/0x9e63ba8af68895cd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779631.450246:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68a00/0x9e63ba8af68895cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779631.450257:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68a00/0x9e63ba8af68895cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787779631.450309:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:0.0:1787779631.450335:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000055780a4a reply state 00000000c490fbed transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68a00/0x9e63ba8af68895cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779631.450344:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1787779631.450392:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:0.0:1787779631.450498:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f53b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+27:10009:x1874622505072128:12345-192.168.201.9@tcp:36:bash.0 Request processed in 511us (687us total) trans 4294967369 rc 0/0 00000100:00100000:0.0:1787779631.450506:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 89 00000020:00080000:0.0:1787779631.450511:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1787779631.452780:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779631.452892:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505072256 00000100:00100000:1.0:1787779631.452910:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505072256 00000100:00100000:1.0:1787779631.452959:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 90 00000100:00100000:1.0:1787779631.452985:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e32940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+27:10009:x1874622505072256:12345-192.168.201.9@tcp:101:bash.0 00010000:00010000:1.0:1787779631.453011:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779631.453030:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af68895d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedad4b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779631.453214:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af68895d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad4b expref: 28 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.456457:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68a00/0x9e63ba8af68895cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.456473:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68a00/0x9e63ba8af68895cd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.456481:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68a00/0x9e63ba8af68895cd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.456488:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e848f68a00 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:3.0:1787779631.456492:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68a00/0x9e63ba8af68895cd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.456502:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68a00/0x9e63ba8af68895cd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.456520:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e87450a000) 00010000:00010000:3.0:1787779631.456524:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779631.456529:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68a00/0x9e63ba8af68895cd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.456547:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68a00/0x9e63ba8af68895cd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779631.461045:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af68895d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad4b expref: 27 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779631.461093:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e87450a000) 00010000:00010000:1.0:1787779631.461096:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787779631.461100:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87a98b600, rc 0) 00000100:00100000:1.0:1787779631.461176:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e32940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+27:10009:x1874622505072256:12345-192.168.201.9@tcp:101:bash.0 Request processed in 8193us (8405us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779631.461186:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 90 00000100:00100000:1.0:1787779631.467246:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779631.471935:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505072384 00000100:00100000:3.0:1787779631.471953:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505072384 00000100:00100000:2.0:1787779631.472069:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 33 00000100:00100000:2.0:1787779631.472079:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f539a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:10009:x1874622505072384:12345-192.168.201.9@tcp:101:bash.0 00010000:00010000:2.0:1787779631.472098:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779631.472118:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c4c5017/0x9e63ba8af68895db lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedad52 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787779631.472145:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a8f5a2c, atime: 0x6a8f5a2a, ctime: 0x6a8f5a2c, blocks: 0xb 00010000:00010000:2.0:1787779631.472166:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=397s v=(0 0) 00010000:00010000:2.0:1787779631.472171:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787779631.472180:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c4c5017/0x9e63ba8af68895db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad52 expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779631.472216:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000c4c5017/0x9e63ba8af68895db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad52 expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779631.472230:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87aa66e00, rc 0) 00000100:00100000:2.0:1787779631.472312:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f539a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+7:10009:x1874622505072384:12345-192.168.201.9@tcp:101:bash.0 Request processed in 234us (5076us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779631.472320:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 33 00000100:00100000:2.0:1787779631.475354:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779631.475675:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505072512 00000100:00100000:1.0:1787779631.475684:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505072512 00002000:00010000:1.0:1787779631.475765:0:6685:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:1.0:1787779631.475770:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98e874221680 with x1874622505072512 ext(0->18446744073709551615) 00002000:00010000:1.0:1787779631.475781:0:6685:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98e874221680. 00000100:00100000:1.0:1787779631.475809:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 1 00000100:00100000:1.0:1787779631.475818:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e874221680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+7:2359:x1874622505072512:12345-192.168.201.9@tcp:10:bash.0 00002000:00010000:1.0:1787779631.476074:0:6685:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1787779631.476077:0:6685:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1787779628 -> 1787779630 00002000:00010000:1.0:1787779631.476091:0:6685:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1787779626 -> 1787779626 00002000:00010000:1.0:1787779631.476093:0:6685:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787779628 -> 1787779630 00002000:00010000:1.0:1787779631.476095:0:6685:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1787779631.476150:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e874221680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+8:2359:x1874622505072512:12345-192.168.201.9@tcp:10:bash.0 Request processed in 334us (804us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1787779631.476157:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 1 00002000:00010000:1.0:1787779631.476160:0:6685:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:1.0:1787779631.476162:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98e874221680 with x1874622505072512 ext(0->18446744073709551615) 00002000:00010000:1.0:1787779631.476166:0:6685:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98e874221680. 00000100:00100000:3.0:1787779631.539057:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e874220780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874622525019264:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787779631.539138:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779631.539373:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525019264 00000100:00100000:0.0:1787779631.539381:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525019264 00000100:00100000:0.0:1787779631.539432:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787779631.539442:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e852b9e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1874622525019264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787779631.539483:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787779631.539550:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e852b9e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1874622525019264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779631.539559:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787779631.539702:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e874220780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874622525019264:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787779631.616057:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779631.616292:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505072640 00000100:00100000:3.0:1787779631.616302:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505072640 00000100:00100000:3.0:1787779631.616377:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 91 00000100:00100000:3.0:1787779631.616388:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e33840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+27:10495:x1874622505072640:12345-192.168.201.9@tcp:34:lfs.0 00010000:00010000:3.0:1787779631.616460:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af68895e2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.616478:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af68895e2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.616489:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af68895e2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.616504:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af68895e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.616511:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af68895e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.616518:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af68895e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.617064:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af68895f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.617086:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af68895f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.617095:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af68895f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787779631.617282:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af68895f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.617295:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af68895e2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.617302:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af68895e2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.617310:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af68895e2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.617316:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e8429d4400 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:3.0:1787779631.617320:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af68895e2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.617328:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af68895e2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.617340:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98e87450a200) 00010000:00010000:3.0:1787779631.617344:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779631.617348:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af68895e2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.617355:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af68895e2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.617434:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af68895e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.617441:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af68895e9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.617447:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af68895e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.617454:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e8429d5c00 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:3.0:1787779631.617457:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af68895e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.617464:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af68895e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.617472:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98e87450ad00) 00010000:00010000:3.0:1787779631.617475:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779631.617478:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af68895e9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.617483:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af68895e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.617498:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af68895f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.617504:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af68895f0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.617510:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af68895f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.617521:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e8429d4e00 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:3.0:1787779631.617524:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af68895f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.617531:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af68895f0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.617539:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e87450a000) 00010000:00010000:3.0:1787779631.617542:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779631.617544:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af68895f0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.617551:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af68895f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779631.617634:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e33840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+27:10495:x1874622505072640:12345-192.168.201.9@tcp:34:lfs.0 Request processed in 1246us (1585us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779631.617644:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 91 00000100:00100000:0.0:1787779631.712319:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779631.712423:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505072896 00000100:00100000:1.0:1787779631.712434:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505072896 00000100:00100000:1.0:1787779631.712497:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 92 00000100:00100000:1.0:1787779631.712507:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e330c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+27:10498:x1874622505072896:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:1.0:1787779631.712529:0:8197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779631.712549:0:8197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af68895f7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedad59 expref: -99 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779631.712622:0:8197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af68895fe lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779631.712637:0:8197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af68895fe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779631.712649:0:8197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af68895fe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779631.712664:0:8197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af6889605 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779631.712698:0:8197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af6889605 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779631.712706:0:8197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af6889605 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779631.713325:0:8197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b800/0x9e63ba8af688960c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779631.713336:0:8197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b800/0x9e63ba8af688960c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779631.713345:0:8197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b800/0x9e63ba8af688960c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787779631.713355:0:8197:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1787779631.713451:0:8197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af68895fe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779631.713458:0:8197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af68895fe lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779631.713465:0:8197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af68895fe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779631.713472:0:8197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87a98a400 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:1.0:1787779631.713477:0:8197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af68895fe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779631.713484:0:8197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af68895fe lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779631.713510:0:8197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98e87450a200) 00010000:00010000:1.0:1787779631.713513:0:8197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787779631.713519:0:8197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af68895fe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779631.713526:0:8197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af68895fe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779631.713539:0:8197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af6889605 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779631.713547:0:8197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af6889605 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779631.713553:0:8197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af6889605 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779631.713559:0:8197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87a98aa00 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:1.0:1787779631.713562:0:8197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af6889605 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779631.713569:0:8197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af6889605 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779631.713577:0:8197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98e860c40800) 00010000:00010000:1.0:1787779631.713579:0:8197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787779631.713582:0:8197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af6889605 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779631.713588:0:8197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af6889605 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779631.713641:0:8197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af68895f7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad59 expref: 30 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779631.713655:0:8197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b800/0x9e63ba8af688960c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad59 expref: 29 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779631.713664:0:8197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e87450a000) 00010000:00010000:1.0:1787779631.713666:0:8197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787779631.713669:0:8197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87a98b800, rc 0) 00000100:00100000:1.0:1787779631.714063:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e330c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+29:10498:x1874622505072896:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 1555us (1751us total) trans 4294967370 rc 0/0 00000100:00100000:1.0:1787779631.714073:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 92 00000100:00100000:2.0:1787779631.723125:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779631.723242:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505073024 00000100:00100000:0.0:1787779631.723251:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505073024 00000100:00100000:0.0:1787779631.723309:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 93 00000100:00100000:0.0:1787779631.723320:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e8742230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+29:10498:x1874622505073024:12345-192.168.201.9@tcp:54:lfs.0 00010000:00010000:0.0:1787779631.723383:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af688961a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779631.723400:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67a00/0x9e63ba8af68895bf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad44 expref: 29 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779631.723410:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af688961a lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779631.723445:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67a00/0x9e63ba8af68895bf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad44 expref: 29 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779631.723459:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67a00/0x9e63ba8af68895bf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad44 expref: 29 pid: 8197 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779631.723495:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e842e30780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5835:1874622525019392:192.168.201.9@tcp:104: 00000100:00100000:0.0:1787779631.723595:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e84721d180 going to sleep for 11 seconds 00000100:00100000:0.0:1787779631.726702:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779631.726833:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e842e30780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5835:1874622525019392:192.168.201.9@tcp:104: 00010000:00010000:2.0:1787779631.726860:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af688961a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779631.727039:0:11475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505073280 00000100:00100000:1.0:1787779631.727046:0:11475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505073280 00000100:00100000:1.0:1787779631.727104:0:11475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 22 00000100:00100000:1.0:1787779631.727114:0:11475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+30:9974:x1874622505073280:12345-192.168.201.9@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787779631.727433:0:11475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+31:9974:x1874622505073280:12345-192.168.201.9@tcp:35:ldlm_bl.0 Request processed in 320us (751us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1787779631.727441:0:11475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 22 00010000:00010000:2.0:1787779631.730985:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779631.733617:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779631.733739:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505073408 00000100:00100000:3.0:1787779631.733756:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505073408 00010000:00010000:3.0:1787779631.733802:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67a00/0x9e63ba8af68895bf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad44 expref: 31 pid: 8197 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779631.733885:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 48 00000100:00100000:3.0:1787779631.733896:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f53ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+31:2360:x1874622505073408:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787779631.733913:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787779631.733920:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67a00/0x9e63ba8af68895bf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad44 expref: 31 pid: 8197 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.733955:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67a00/0x9e63ba8af68895bf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad44 expref: 31 pid: 8197 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.733981:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67a00/0x9e63ba8af68895bf lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad44 expref: 31 pid: 8197 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.733999:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e87450a000) 00010000:00010000:3.0:1787779631.734005:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af688961a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.734014:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af688961a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.734023:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af688961a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.734057:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787779631.734107:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f53ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+30:2360:x1874622505073408:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 212us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779631.734114:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 48 00010000:00010000:2.0:1787779631.738056:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af688961a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779631.738076:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af688961a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779631.738124:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af688961a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779631.738132:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af688961a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779631.738139:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af688961a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779631.738167:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e848f68000 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:2.0:1787779631.738171:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af688961a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779631.738179:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af688961a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779631.738198:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e87450a000) 00010000:00010000:2.0:1787779631.738201:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787779631.738206:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af688961a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779631.738212:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af688961a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779631.738319:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e8742230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+29:10498:x1874622505073024:12345-192.168.201.9@tcp:54:lfs.0 Request processed in 14997us (15200us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779631.738329:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 93 00000100:00100000:1.0:1787779631.749768:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779631.750577:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505073664 00000100:00100000:0.0:1787779631.750589:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505073664 00000100:00100000:0.0:1787779631.750655:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 23 00000100:00100000:0.0:1787779631.750667:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f53bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+29:10498:x1874622505073664:12345-192.168.201.9@tcp:35:lfs.0 00000100:00100000:0.0:1787779631.750983:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f53bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+30:10498:x1874622505073664:12345-192.168.201.9@tcp:35:lfs.0 Request processed in 318us (1247us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1787779631.750992:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 23 00000040:00080000:3.0:1787779631.796519:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787779631.796528:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787779631.796560:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1787779631.796569:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787779631.951505:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779631.953305:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505073920 00000100:00100000:3.0:1787779631.953317:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505073920 00000100:00100000:3.0:1787779631.953388:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 94 00000100:00100000:3.0:1787779631.953398:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e32d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+30:10509:x1874622505073920:12345-192.168.201.9@tcp:101:cat.0 00010000:00010000:3.0:1787779631.953436:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779631.953457:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af6889621 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedad60 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.953532:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af6889628 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.953547:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af6889628 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.953559:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af6889628 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.953573:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af688962f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.953581:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af688962f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.953588:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af688962f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.954243:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af6889636 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.954253:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af6889636 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.954261:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af6889636 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787779631.954271:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:3.0:1787779631.954367:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af6889628 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.954375:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af6889628 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.954382:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af6889628 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.954388:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e8429d5c00 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:3.0:1787779631.954392:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af6889628 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.954399:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af6889628 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.954411:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98e87450a200) 00010000:00010000:3.0:1787779631.954414:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779631.954419:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af6889628 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.954425:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af6889628 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.954438:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af688962f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.954445:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af688962f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.954450:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af688962f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.954456:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e8429d4400 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:3.0:1787779631.954467:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af688962f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.954474:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af688962f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.954483:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98e87450ad00) 00010000:00010000:3.0:1787779631.954486:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779631.954489:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af688962f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.954495:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af688962f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.954554:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af6889621 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad60 expref: 33 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.954571:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af6889636 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad60 expref: 32 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779631.954577:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e87450a000) 00010000:00010000:3.0:1787779631.954580:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787779631.954582:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e8429d4000, rc 0) 00000100:00100000:3.0:1787779631.955308:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e32d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+32:10509:x1874622505073920:12345-192.168.201.9@tcp:101:cat.0 Request processed in 1910us (3811us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1787779631.955318:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 94 00000100:00100000:3.0:1787779631.978863:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779631.979155:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505074176 00000100:00100000:0.0:1787779631.979166:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505074176 00000100:00100000:0.0:1787779631.979238:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 24 00000100:00100000:0.0:1787779631.979249:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e852b9f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+32:10509:x1874622505074176:12345-192.168.201.9@tcp:35:cat.0 00000100:00100000:0.0:1787779631.979511:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e852b9f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+33:10509:x1874622505074176:12345-192.168.201.9@tcp:35:cat.0 Request processed in 264us (660us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1787779631.979519:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 24 00000100:00100000:1.0:1787779632.025067:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779632.028180:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505074432 00000100:00100000:3.0:1787779632.028193:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505074432 00000100:00100000:3.0:1787779632.028288:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 95 00000100:00100000:3.0:1787779632.028314:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f53a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+33:10510:x1874622505074432:12345-192.168.201.9@tcp:36:rm.0 00010000:00010000:3.0:1787779632.028383:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787779632.028411:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af6889636 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad60 expref: 33 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.028437:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b800/0x9e63ba8af688960c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad59 expref: 32 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.028450:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af68895d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad4b expref: 31 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.028460:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e87450a000) 00010000:00010000:3.0:1787779632.028471:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787779632.028489:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af6889644 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.028505:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af6889644 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.028516:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af6889644 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.028530:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af688964b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.028536:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af688964b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.028543:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af688964b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.028928:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af6889652 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.028938:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af6889652 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.028945:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af6889652 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787779632.029536:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:3.0:1787779632.029547:0:5836:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 397770834321ns, next at 398770831655ns, rc = 0 00010000:00010000:3.0:1787779632.029604:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af6889659 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.029615:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af6889659 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.029623:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af6889659 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.029630:0:5836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af6889659 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.029636:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af6889659 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.029641:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af6889659 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.029658:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787779632.029679:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af6889652 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.029691:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af6889652 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.029696:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af6889652 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.029701:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e8429d5c00 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:3.0:1787779632.029706:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af6889652 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.029753:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af6889652 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.029763:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e87450a300) 00010000:00010000:3.0:1787779632.029766:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787779632.029771:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af6889652 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.029777:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af6889652 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.029795:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af6889644 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.029801:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af6889644 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.029808:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af6889644 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.029812:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e8429d4e00 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:3.0:1787779632.029822:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af6889644 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.029829:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af6889644 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.029837:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98e87450a200) 00010000:00010000:3.0:1787779632.029839:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779632.029842:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af6889644 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.029847:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af6889644 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787779632.029858:0:5836:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004b986869 reply state 000000003e3737b6 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af688964b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779632.029866:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787779632.029951:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f53a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+32:10510:x1874622505074432:12345-192.168.201.9@tcp:36:rm.0 Request processed in 1637us (4892us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1787779632.029959:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 95 00000100:00080000:0.0:1787779632.030168:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787779632.034822:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787779632.034838:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af6889659 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779632.034849:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e8429d5000 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:2.0:1787779632.034854:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af6889659 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779632.034864:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af6889659 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779632.034882:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e87450a300) 00010000:00010000:2.0:1787779632.034901:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787779632.034907:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af6889659 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779632.034913:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af6889659 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779632.034940:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779632.034942:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779632.034944:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787779632.048178:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af688964b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.048195:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af688964b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.048202:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af688964b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.048208:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e8429d4400 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:3.0:1787779632.048212:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af688964b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.048234:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af688964b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.048250:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98e87450ad00) 00010000:00010000:3.0:1787779632.048253:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779632.048258:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af688964b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.048264:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af688964b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779632.114178:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779632.114275:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505074688 00000100:00100000:0.0:1787779632.114284:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505074688 00000100:00100000:0.0:1787779632.114342:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 96 00000100:00100000:0.0:1787779632.114361:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e88195e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+31:10516:x1874622505074688:12345-192.168.201.9@tcp:101:bash.0 00010000:00010000:0.0:1787779632.114385:0:8197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787779632.114420:0:8197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af6889660 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedad67 expref: -99 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.114555:0:8197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af6889667 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.114570:0:8197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af6889667 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.114583:0:8197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af6889667 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.114598:0:8197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af688966e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.114605:0:8197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af688966e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.114611:0:8197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af688966e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787779632.115287:0:8197:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:0.0:1787779632.115443:0:8197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af6889675 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.115455:0:8197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af6889675 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.115464:0:8197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af6889675 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.115499:0:8197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af6889667 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.115519:0:8197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af6889667 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.115526:0:8197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af6889667 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.115533:0:8197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e848f68200 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:0.0:1787779632.115537:0:8197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af6889667 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.115544:0:8197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af6889667 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.115556:0:8197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98e87450a200) 00010000:00010000:0.0:1787779632.115559:0:8197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787779632.115563:0:8197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af6889667 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.115569:0:8197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af6889667 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787779632.115582:0:8197:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002e944fd2 reply state 00000000a4523ffa transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af688966e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779632.115591:0:8197:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787779632.115619:0:8197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af6889660 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad67 expref: 34 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.115631:0:8197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af6889675 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad67 expref: 33 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.115648:0:8197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98e860e78100) 00010000:00010000:0.0:1787779632.115650:0:8197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787779632.115652:0:8197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e848f69200, rc 0) 00000100:00100000:0.0:1787779632.120199:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e88195e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+34:10516:x1874622505074688:12345-192.168.201.9@tcp:101:bash.0 Request processed in 5836us (6019us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1787779632.120212:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 96 00010000:00010000:3.0:1787779632.120885:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af688966e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.120899:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af688966e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.120906:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af688966e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.120912:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e848f69600 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:3.0:1787779632.120916:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af688966e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.120924:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af688966e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.120941:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98e860e78c00) 00010000:00010000:3.0:1787779632.120944:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779632.120949:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af688966e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.120970:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af688966e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779632.121407:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779632.121513:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505074816 00000100:00100000:2.0:1787779632.121522:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505074816 00000100:00100000:2.0:1787779632.121585:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 34 00000100:00100000:2.0:1787779632.121594:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e32580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+7:2360:x1874622505074816:12345-192.168.201.9@tcp:101:bash.0 00010000:00010000:2.0:1787779632.121611:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779632.121628:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004a4d0f41/0x9e63ba8af6889683 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedad6e expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787779632.121666:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787779632.121699:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=397s v=(0 0) 00010000:00010000:2.0:1787779632.121704:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787779632.121746:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a4d0f41/0x9e63ba8af6889683 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad6e expref: 8 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779632.121765:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004a4d0f41/0x9e63ba8af6889683 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad6e expref: 8 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779632.121778:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87aa67600, rc 0) 00000100:00100000:2.0:1787779632.121827:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e32580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+8:2360:x1874622505074816:12345-192.168.201.9@tcp:101:bash.0 Request processed in 234us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779632.121840:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 34 00000100:00080000:0.0:1787779632.121985:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787779632.133668:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779632.134202:0:10229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505074944 00000100:00100000:3.0:1787779632.134212:0:10229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505074944 00000100:00100000:2.0:1787779632.134348:0:10229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 35 00000100:00100000:2.0:1787779632.134367:0:10229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e88195da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+8:10516:x1874622505074944:12345-192.168.201.9@tcp:101:bash.0 00010000:00010000:2.0:1787779632.134386:0:10229:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779632.134404:0:10229:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e4937c8/0x9e63ba8af688968a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedad75 expref: -99 pid: 10229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779632.134435:0:10229:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004a4d0f41/0x9e63ba8af6889683 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad6e expref: 9 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779632.134443:0:10229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787779632.134448:0:10229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787779632.134453:0:10229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e4937c8/0x9e63ba8af688968a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad75 expref: 9 pid: 10229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779632.134483:0:10229:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004a4d0f41/0x9e63ba8af6889683 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad6e expref: 9 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779632.134497:0:10229:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004a4d0f41/0x9e63ba8af6889683 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad6e expref: 9 pid: 6682 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779632.134512:0:10229:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e874220780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10229:1874622525019520:192.168.201.9@tcp:104: 00000100:00100000:2.0:1787779632.134617:0:10229:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e8521e0480 going to sleep for 11 seconds 00000100:00100000:1.0:1787779632.137652:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779632.137791:0:11162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505075072 00000100:00100000:0.0:1787779632.137801:0:11162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505075072 00010000:00010000:0.0:1787779632.137839:0:11162:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004a4d0f41/0x9e63ba8af6889683 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad6e expref: 10 pid: 6682 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779632.137881:0:11162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 49 00000100:00100000:0.0:1787779632.137890:0:11162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e847d95450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+10:2360:x1874622505075072:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787779632.137904:0:11162:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787779632.137927:0:11162:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004a4d0f41/0x9e63ba8af6889683 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad6e expref: 10 pid: 6682 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.137941:0:11162:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004a4d0f41/0x9e63ba8af6889683 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad6e expref: 10 pid: 6682 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.137967:0:11162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787779632.137972:0:11162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787779632.137980:0:11162:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002e4937c8/0x9e63ba8af688968a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad75 expref: 10 pid: 10229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.138003:0:11162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e4937c8/0x9e63ba8af688968a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad75 expref: 10 pid: 10229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.138038:0:11162:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002e4937c8/0x9e63ba8af688968a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad75 expref: 10 pid: 10229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779632.138052:0:11162:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e842e30780 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11162:1874622525019648:192.168.201.9@tcp:105: 00000100:00100000:0.0:1787779632.138125:0:11162:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e84721dd80 going to sleep for 11 seconds 00010000:00010000:2.0:1787779632.139494:0:10229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004a4d0f41/0x9e63ba8af6889683 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad6e expref: 10 pid: 6682 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779632.139528:0:10229:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e874220780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10229:1874622525019520:192.168.201.9@tcp:104: 00010000:00010000:2.0:1787779632.139555:0:10229:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002e4937c8/0x9e63ba8af688968a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad75 expref: 9 pid: 10229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779632.139566:0:10229:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87aa66400, rc 0) 00000100:00100000:2.0:1787779632.139618:0:10229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e88195da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+9:10516:x1874622505074944:12345-192.168.201.9@tcp:101:bash.0 Request processed in 5252us (5958us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779632.139626:0:10229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 35 00000100:00100000:1.0:1787779632.147110:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779632.147294:0:11162:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e842e30780 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11162:1874622525019648:192.168.201.9@tcp:105: 00010000:00010000:0.0:1787779632.147328:0:11162:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787779632.147419:0:11162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e847d95450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+8:2360:x1874622505075072:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 9528us (9781us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779632.147434:0:11162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 49 00000100:00100000:2.0:1787779632.151600:0:11475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505075328 00000100:00100000:2.0:1787779632.151619:0:11475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505075328 00000100:00100000:2.0:1787779632.151999:0:11475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 25 00000100:00100000:2.0:1787779632.152011:0:11475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e88195fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+33:10516:x1874622505075328:12345-192.168.201.9@tcp:35:bash.0 00000100:00100000:2.0:1787779632.153281:0:11475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e88195fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+34:10516:x1874622505075328:12345-192.168.201.9@tcp:35:bash.0 Request processed in 1264us (6176us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1787779632.153293:0:11475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 25 00000100:00100000:3.0:1787779632.288417:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779632.288465:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779632.288567:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505075584 00000100:00100000:2.0:1787779632.288578:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505075584 00000100:00100000:2.0:1787779632.288639:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 36 00000100:00100000:2.0:1787779632.288649:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e852b9f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+8:2359:x1874622505075584:12345-192.168.201.9@tcp:16:kworker.0 00000100:00100000:2.0:1787779632.288847:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e852b9f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+8:2359:x1874622505075584:12345-192.168.201.9@tcp:16:kworker.0 Request processed in 198us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779632.288855:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 36 00000100:00100000:0.0:1787779632.289699:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505075456 00000100:00100000:0.0:1787779632.289707:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505075456 00002000:00100000:0.0:1787779632.289781:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff98e852b9c780 x1874622505075456/t0(0) o4->e225400f-8d32-48a8-ab5e-fe4d3780a20c@192.168.201.9@tcp:43/0 lens 504/0 e 0 to 0 dl 1787779643 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787779632.289802:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98e852b9c780 with x1874622505075456 ext(0->8) 00002000:00010000:0.0:1787779632.289808:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98e852b9c780 00000100:00100000:0.0:1787779632.290059:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 2 00000100:00100000:0.0:1787779632.290069:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e852b9c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+8:2359:x1874622505075456:12345-192.168.201.9@tcp:4:bash.0 00000100:00100000:0.0:1787779632.290587:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e852b9c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+10:2359:x1874622505075456:12345-192.168.201.9@tcp:4:bash.0 Request processed in 519us (2120us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1787779632.290605:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 2 00002000:00100000:0.0:1787779632.290614:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff98e852b9c780 x1874622505075456/t4294967302(0) o4->e225400f-8d32-48a8-ab5e-fe4d3780a20c@192.168.201.9@tcp:43/0 lens 504/448 e 0 to 0 dl 1787779643 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787779632.290623:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98e852b9c780 with x1874622505075456 ext(0->8) 00002000:00010000:0.0:1787779632.290627:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98e852b9c780 00000100:00100000:3.0:1787779632.383167:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779632.383269:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505075712 00000100:00100000:1.0:1787779632.383280:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505075712 00000100:00100000:1.0:1787779632.383343:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 97 00000100:00100000:1.0:1787779632.383362:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e852b9fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+34:10532:x1874622505075712:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:1.0:1787779632.383387:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779632.383407:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b800/0x9e63ba8af6889691 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedad7c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779632.383470:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889698 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779632.383486:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889698 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779632.383500:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889698 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787779632.383560:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:1.0:1787779632.383565:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787779632.383587:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889698 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779632.383613:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b800/0x9e63ba8af6889691 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad7c expref: 36 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779632.383630:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889698 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad7c expref: 35 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779632.383639:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98e87450a200) 00010000:00010000:1.0:1787779632.383642:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787779632.383660:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87a98ae00, rc 0) 00000100:00100000:1.0:1787779632.384013:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e852b9fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+35:10532:x1874622505075712:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 660us (856us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779632.384020:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 97 00000100:00100000:1.0:1787779632.402847:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779632.402971:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505075968 00000100:00100000:0.0:1787779632.402987:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505075968 00000100:00100000:0.0:1787779632.403102:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 98 00000100:00100000:0.0:1787779632.403112:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec19a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+35:10532:x1874622505075968:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:0.0:1787779632.403135:0:8197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787779632.403159:0:8197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af688969f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedad83 expref: -99 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.403271:0:8197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68400/0x9e63ba8af68896a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.403286:0:8197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68400/0x9e63ba8af68896a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.403297:0:8197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68400/0x9e63ba8af68896a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787779632.403308:0:8197:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787779632.403516:0:8197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af688969f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad83 expref: 38 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.403536:0:8197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68400/0x9e63ba8af68896a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad83 expref: 37 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.403559:0:8197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98e860e78100) 00010000:00010000:0.0:1787779632.403562:0:8197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787779632.403566:0:8197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e848f68400, rc 0) 00000100:00100000:0.0:1787779632.403683:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec19a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+37:10532:x1874622505075968:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 564us (838us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1787779632.403697:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 98 00000100:00100000:0.0:1787779632.409324:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779632.409421:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779632.409535:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505076224 00000100:00100000:3.0:1787779632.409545:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505076224 00000100:00100000:3.0:1787779632.409612:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 99 00000100:00100000:3.0:1787779632.409624:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e30780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+37:10532:x1874622505076224:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:3.0:1787779632.409651:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779632.409684:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af68896b4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedad8a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.409834:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af68896bb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.409853:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af68896bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.409866:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af68896bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787779632.409880:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1787779632.410023:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af68896b4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad8a expref: 40 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.410065:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af68896bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad8a expref: 39 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.410073:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98e860e78100) 00010000:00010000:3.0:1787779632.410075:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787779632.410079:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e8429d4e00, rc 0) 00000100:00100000:3.0:1787779632.410141:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e30780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+39:10532:x1874622505076224:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 520us (719us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1787779632.410148:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 99 00000100:00100000:3.0:1787779632.415969:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779632.416020:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505076480 00000100:00100000:3.0:1787779632.416932:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505076480 00000100:00100000:3.0:1787779632.417005:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 37 00000100:00100000:3.0:1787779632.417016:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e852b9da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+10:2359:x1874622505076480:12345-192.168.201.9@tcp:1:lfs.0 00010000:00010000:3.0:1787779632.417061:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c41683e/0x9e63ba8af68896c9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.417082:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002e4937c8/0x9e63ba8af688968a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad75 expref: 10 pid: 10229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.417090:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787779632.417094:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787779632.417099:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c41683e/0x9e63ba8af68896c9 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.417152:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002e4937c8/0x9e63ba8af688968a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad75 expref: 10 pid: 10229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.417167:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002e4937c8/0x9e63ba8af688968a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad75 expref: 10 pid: 10229 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779632.417183:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e852b9ed00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1874622525019776:192.168.201.9@tcp:104: 00000100:00100000:3.0:1787779632.417281:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e87f036c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787779632.423970:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779632.424044:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e852b9ed00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1874622525019776:192.168.201.9@tcp:104: 00010000:00010000:3.0:1787779632.424074:0:6680:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001c41683e/0x9e63ba8af68896c9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779632.427615:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505076352 00000100:00100000:1.0:1787779632.430283:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505076352 00000100:00100000:1.0:1787779632.430383:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505076608 00000100:00100000:1.0:1787779632.430389:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505076608 00010000:00010000:1.0:1787779632.430410:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002e4937c8/0x9e63ba8af688968a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad75 expref: 11 pid: 10229 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779632.430433:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 50 00000100:00100000:1.0:1787779632.430441:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e33c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+11:2360:x1874622505076608:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787779632.430456:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787779632.430475:0:5821:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787779632.430478:0:5821:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787779631 00002000:00010000:1.0:1787779632.430480:0:5821:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1787779631 00010000:00010000:1.0:1787779632.430485:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002e4937c8/0x9e63ba8af688968a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad75 expref: 11 pid: 10229 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779632.430500:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002e4937c8/0x9e63ba8af688968a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad75 expref: 11 pid: 10229 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779632.430527:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e4937c8/0x9e63ba8af688968a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad75 expref: 11 pid: 10229 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779632.430545:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787779632.430565:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787779632.430571:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001c41683e/0x9e63ba8af68896c9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779632.430582:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c41683e/0x9e63ba8af68896c9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779632.430613:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787779632.430669:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e33c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+10:2360:x1874622505076608:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 228us (6710us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779632.430698:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 50 00000100:00100000:1.0:1787779632.430745:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 6 00000100:00100000:1.0:1787779632.430753:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e30f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+39:2358:x1874622505076352:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787779632.430761:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787779632.430776:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68400/0x9e63ba8af68896a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad83 expref: 39 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779632.431007:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98e860e78100) 00010000:00010000:1.0:1787779632.431013:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787779632.431035:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e30f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+38:2358:x1874622505076352:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 284us (21722us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779632.431042:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 6 00010000:00010000:1.0:1787779632.431192:0:6680:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001c41683e/0x9e63ba8af68896c9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779632.431203:0:6680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001c41683e/0x9e63ba8af68896c9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779632.431242:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c41683e/0x9e63ba8af68896c9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779632.431251:0:6680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001c41683e/0x9e63ba8af68896c9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779632.431259:0:6680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001c41683e/0x9e63ba8af68896c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779632.431266:0:6680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e8429d5c00 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:1.0:1787779632.431270:0:6680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001c41683e/0x9e63ba8af68896c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779632.431279:0:6680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001c41683e/0x9e63ba8af68896c9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779632.431290:0:6680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001c41683e/0x9e63ba8af68896c9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779632.431297:0:6680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001c41683e/0x9e63ba8af68896c9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779632.432601:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e852b9da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+9:2359:x1874622505076480:12345-192.168.201.9@tcp:1:lfs.0 Request processed in 15579us (16634us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779632.432613:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 37 00000100:00100000:0.0:1787779632.436537:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779632.436633:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505076864 00000100:00100000:1.0:1787779632.436643:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505076864 00000100:00100000:2.0:1787779632.437229:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 26 00000100:00100000:2.0:1787779632.437258:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e86c758c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+38:10532:x1874622505076864:12345-192.168.201.9@tcp:35:lfs.0 00000004:00010000:2.0:1787779632.437323:0:5838:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af68896bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad8a expref: 38 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787779632.437696:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:2.0:1787779632.437796:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:2.0:1787779632.438195:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:2.0:1787779632.438248:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67400/0x9e63ba8af68896d0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779632.438265:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af6889675 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad67 expref: 42 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779632.438274:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67400/0x9e63ba8af68896d0 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779632.438309:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af6889675 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad67 expref: 42 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779632.438324:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af6889675 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad67 expref: 42 pid: 8197 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779632.438338:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e874220780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5838:1874622525019904:192.168.201.9@tcp:104: 00000100:00100000:2.0:1787779632.439191:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e8521e0b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787779632.442650:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779632.443158:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505076992 00000100:00100000:3.0:1787779632.443167:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505076992 00010000:00010000:3.0:1787779632.443209:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af6889675 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad67 expref: 43 pid: 8197 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779632.443251:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 51 00000100:00100000:3.0:1787779632.443261:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e33480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+43:2359:x1874622505076992:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787779632.443276:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787779632.443283:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af6889675 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad67 expref: 43 pid: 8197 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.443298:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af6889675 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad67 expref: 43 pid: 8197 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.443334:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98e860e78100) 00010000:00010000:3.0:1787779632.443340:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67400/0x9e63ba8af68896d0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.443409:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67400/0x9e63ba8af68896d0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.443418:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67400/0x9e63ba8af68896d0 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.443439:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787779632.443493:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e33480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+43:2359:x1874622505076992:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 233us (853us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779632.443501:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 51 00010000:00010000:2.0:1787779632.444555:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af6889675 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad67 expref: 42 pid: 8197 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779632.444576:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e874220780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5838:1874622525019904:192.168.201.9@tcp:104: 00010000:00010000:2.0:1787779632.444614:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67400/0x9e63ba8af68896d0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779632.444624:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67400/0x9e63ba8af68896d0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779632.444630:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67400/0x9e63ba8af68896d0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787779632.446610:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1787779632.446871:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:2.0:1787779632.446983:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e874220780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5838:1874622525020032:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787779632.447067:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779632.447094:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e8521e0900 going to sleep for 11 seconds 00000100:00100000:1.0:1787779632.447221:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525020032 00000100:00100000:1.0:1787779632.447228:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525020032 00000100:00100000:1.0:1787779632.447287:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787779632.447296:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e874221e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5838:x1874622525020032:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787779632.447382:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e874221e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5838:x1874622525020032:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 86us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779632.447390:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1787779632.447597:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787779632.447630:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e874220780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5838:1874622525020032:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1787779632.448155:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:2.0:1787779632.448212:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e874220780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5838:1874622525020160:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787779632.448246:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779632.448260:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e8521e0b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787779632.448461:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525020160 00000100:00100000:1.0:1787779632.448466:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525020160 00000100:00100000:1.0:1787779632.448500:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787779632.448508:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e8742221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5838:x1874622525020160:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787779632.448663:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e8742221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:5838:x1874622525020160:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 155us (416us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1787779632.448681:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787779632.448844:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e874220780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5838:1874622525020160:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787779632.448891:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:3.0:1787779632.448929:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67400/0x9e63ba8af68896d0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.448940:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67400/0x9e63ba8af68896d0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.448947:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67400/0x9e63ba8af68896d0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.448953:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87aa67400 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:3.0:1787779632.448957:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67400/0x9e63ba8af68896d0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.448977:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67400/0x9e63ba8af68896d0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.448995:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98e860e78100) 00010000:00010000:3.0:1787779632.448998:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787779632.449002:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67400/0x9e63ba8af68896d0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.449021:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67400/0x9e63ba8af68896d0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787779632.449191:0:5838:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787779632.449291:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:3.0:1787779632.449300:0:5838:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 398190588321ns, next at 399190586425ns, rc = 0 00000001:00080000:3.0:1787779632.449306:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:3.0:1787779632.449338:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98e860e78100) 00010000:00010000:3.0:1787779632.449341:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787779632.449606:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af68896bb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad8a expref: 46 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779632.449954:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e86c758c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+45:10532:x1874622505076864:12345-192.168.201.9@tcp:35:lfs.0 Request processed in 12698us (13425us total) trans 4294967388 rc 0/0 00000100:00100000:3.0:1787779632.449964:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 26 00000020:00080000:3.0:1787779632.449969:0:5838:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1787779632.459405:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779632.459482:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505077120 00000100:00100000:3.0:1787779632.459492:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505077120 00000100:00100000:3.0:1787779632.459588:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 100 00000100:00100000:3.0:1787779632.459599:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a70a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+45:10532:x1874622505077120:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:3.0:1787779632.459633:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779632.459654:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af68896d7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedad91 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.460084:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af68896d7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad91 expref: 46 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.460100:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af68896d7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad91 expref: 46 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.460121:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98e87450ad00) 00010000:00010000:3.0:1787779632.460124:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787779632.460128:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e8429d4400, rc 0) 00000100:00100000:3.0:1787779632.460182:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a70a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+46:10532:x1874622505077120:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 584us (843us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779632.460189:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 100 00000100:00100000:1.0:1787779632.465869:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779632.466029:0:11475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505077376 00000100:00100000:3.0:1787779632.466039:0:11475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505077376 00000100:00100000:3.0:1787779632.466095:0:11475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 27 00000100:00100000:3.0:1787779632.466105:0:11475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec18780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+46:10532:x1874622505077376:12345-192.168.201.9@tcp:35:lfs.0 00000100:00100000:3.0:1787779632.466420:0:11475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec18780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+47:10532:x1874622505077376:12345-192.168.201.9@tcp:35:lfs.0 Request processed in 315us (559us total) trans 4294967389 rc 0/0 00000100:00100000:3.0:1787779632.466429:0:11475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 27 00000100:00100000:2.0:1787779632.563697:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87a7083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874622525020416:0@lo:400:kworker.0 00000100:00100000:2.0:1787779632.563825:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779632.563897:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787779632.563903:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87a708b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c28aae66-2825-42c5-8f52-61f687e868c9:3307:1874622525020288:0@lo:400:kworker.0 00000100:00100000:2.0:1787779632.563936:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779632.563957:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e851683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1874622525020800:0@lo:400:kworker.0 00000100:00100000:2.0:1787779632.564001:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779632.564027:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87aa57840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874622525020672:0@lo:400:kworker.0 00000100:00100000:2.0:1787779632.564061:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779632.564082:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787779632.564087:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87aa561c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1874622525020544:0@lo:400:kworker.0 00000100:00100000:2.0:1787779632.564109:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779632.564134:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525020416 00000100:00100000:2.0:1787779632.564142:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525020416 00000100:00100000:2.0:1787779632.564186:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525020800 00000100:00100000:2.0:1787779632.564189:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525020800 00000100:00100000:2.0:1787779632.564211:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525020544 00000100:00100000:2.0:1787779632.564214:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525020544 00000100:00100000:2.0:1787779632.564229:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787779632.564236:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e8516830c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874622525020416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779632.564286:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e8516830c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874622525020416:12345-0@lo:400:kworker.0 Request processed in 49us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779632.564293:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787779632.564310:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787779632.564316:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e851681680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874622525020800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779632.564341:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e851681680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874622525020800:12345-0@lo:400:kworker.0 Request processed in 26us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779632.564747:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525020672 00000100:00100000:1.0:1787779632.564751:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525020672 00000100:00100000:1.0:1787779632.564796:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787779632.564805:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e851682d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1874622525020672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779632.564849:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e851682d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1874622525020672:12345-0@lo:400:kworker.0 Request processed in 46us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779632.564856:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787779632.564877:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787779632.564885:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e8516803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874622525020544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779632.564912:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e8516803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874622525020544:12345-0@lo:400:kworker.0 Request processed in 29us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779632.564928:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787779632.564947:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525020288 00000100:00100000:1.0:1787779632.564951:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525020288 00000100:00100000:1.0:1787779632.564979:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1787779632.564985:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ebf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+19:3307:x1874622525020288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779632.565017:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ebf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+19:3307:x1874622525020288:12345-0@lo:400:kworker.0 Request processed in 32us (1080us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779632.565022:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1787779632.565080:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87aa561c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1874622525020544:0@lo:400:kworker.0 00000100:00100000:1.0:1787779632.565092:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87aa57840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874622525020672:0@lo:400:kworker.0 00000100:00080000:1.0:1787779632.565124:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787779632.565129:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787779632.565151:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87a708b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c28aae66-2825-42c5-8f52-61f687e868c9:3307:1874622525020288:0@lo:400:kworker.0 00000100:00100000:1.0:1787779632.565162:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e851683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1874622525020800:0@lo:400:kworker.0 00000100:00100000:1.0:1787779632.565171:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87a7083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874622525020416:0@lo:400:kworker.0 00000100:00100000:2.0:1787779632.565450:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787779632.601383:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779632.601420:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505077504 00000100:00100000:0.0:1787779632.601430:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505077504 00000100:00100000:0.0:1787779632.601489:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 101 00000100:00100000:0.0:1787779632.601500:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e852b9f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+47:10542:x1874622505077504:12345-192.168.201.9@tcp:34:lfs.0 00010000:00010000:0.0:1787779632.601588:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68800/0x9e63ba8af68896de lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.601605:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68800/0x9e63ba8af68896de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.601617:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68800/0x9e63ba8af68896de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.601632:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af68896e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.601639:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af68896e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.601654:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af68896e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.601808:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68e00/0x9e63ba8af68896ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.601818:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68e00/0x9e63ba8af68896ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.601825:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68e00/0x9e63ba8af68896ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787779632.601870:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68e00/0x9e63ba8af68896ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.601883:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68800/0x9e63ba8af68896de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.601889:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68800/0x9e63ba8af68896de lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.601895:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68800/0x9e63ba8af68896de lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.601901:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e848f68800 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:0.0:1787779632.601905:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68800/0x9e63ba8af68896de lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.601912:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68800/0x9e63ba8af68896de lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.601924:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98e87450a200) 00010000:00010000:0.0:1787779632.601933:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787779632.601938:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68800/0x9e63ba8af68896de lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.601944:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68800/0x9e63ba8af68896de lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.601955:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af68896e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.601961:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af68896e5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.601968:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af68896e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.601973:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e848f69200 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:0.0:1787779632.601976:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af68896e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.601982:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af68896e5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.601989:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98e860e78300) 00010000:00010000:0.0:1787779632.601991:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787779632.601994:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af68896e5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.602000:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af68896e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.602014:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68e00/0x9e63ba8af68896ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.602026:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68e00/0x9e63ba8af68896ec lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.602031:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68e00/0x9e63ba8af68896ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.602036:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e848f68e00 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:0.0:1787779632.602039:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68e00/0x9e63ba8af68896ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.602046:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68e00/0x9e63ba8af68896ec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.602053:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98e87450ad00) 00010000:00010000:0.0:1787779632.602056:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787779632.602059:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68e00/0x9e63ba8af68896ec lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.602065:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68e00/0x9e63ba8af68896ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779632.602145:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e852b9f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+47:10542:x1874622505077504:12345-192.168.201.9@tcp:34:lfs.0 Request processed in 646us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779632.602154:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 101 00000100:00100000:3.0:1787779632.675683:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779632.675921:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505077760 00000100:00100000:2.0:1787779632.675931:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505077760 00000100:00100000:2.0:1787779632.675998:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 102 00000100:00100000:2.0:1787779632.676009:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e852b9ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+47:10545:x1874622505077760:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:2.0:1787779632.676031:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779632.676072:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66000/0x9e63ba8af68896f3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedad98 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779632.676149:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67200/0x9e63ba8af68896fa lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779632.676163:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67200/0x9e63ba8af68896fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779632.676174:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67200/0x9e63ba8af68896fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779632.676189:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66600/0x9e63ba8af6889701 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779632.676197:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66600/0x9e63ba8af6889701 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779632.676202:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66600/0x9e63ba8af6889701 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779632.676332:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67400/0x9e63ba8af6889708 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779632.676353:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67400/0x9e63ba8af6889708 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779632.676362:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67400/0x9e63ba8af6889708 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787779632.676371:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787779632.676477:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67200/0x9e63ba8af68896fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779632.676494:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67200/0x9e63ba8af68896fa lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779632.676501:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67200/0x9e63ba8af68896fa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779632.676508:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87aa67200 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:2.0:1787779632.676513:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67200/0x9e63ba8af68896fa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779632.676522:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67200/0x9e63ba8af68896fa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779632.676535:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98e87450a200) 00010000:00010000:2.0:1787779632.676539:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787779632.676544:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67200/0x9e63ba8af68896fa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779632.676550:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67200/0x9e63ba8af68896fa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779632.676565:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66600/0x9e63ba8af6889701 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779632.676571:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66600/0x9e63ba8af6889701 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779632.676576:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66600/0x9e63ba8af6889701 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779632.676580:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87aa66600 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:2.0:1787779632.676589:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66600/0x9e63ba8af6889701 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779632.676596:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66600/0x9e63ba8af6889701 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779632.676603:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98e84927fa00) 00010000:00010000:2.0:1787779632.676606:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787779632.676608:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66600/0x9e63ba8af6889701 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779632.676614:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66600/0x9e63ba8af6889701 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779632.676666:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66000/0x9e63ba8af68896f3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad98 expref: 50 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779632.676680:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67400/0x9e63ba8af6889708 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad98 expref: 49 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779632.676687:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98e87450ad00) 00010000:00010000:2.0:1787779632.676689:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787779632.676691:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87aa67400, rc 0) 00000100:00100000:2.0:1787779632.677114:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e852b9ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+49:10545:x1874622505077760:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 1104us (1451us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1787779632.677123:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 102 00000100:00100000:2.0:1787779632.682032:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779632.682100:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505077888 00000100:00100000:3.0:1787779632.682123:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505077888 00000100:00100000:3.0:1787779632.682185:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 103 00000100:00100000:3.0:1787779632.682195:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e851683480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+49:10545:x1874622505077888:12345-192.168.201.9@tcp:54:lfs.0 00010000:00010000:3.0:1787779632.682260:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af6889716 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.682277:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af6889716 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.682289:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af6889716 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.682315:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af6889716 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.682322:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af6889716 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.682329:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af6889716 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.682336:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e8429d4e00 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:3.0:1787779632.682340:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af6889716 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.682359:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af6889716 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.682370:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98e87450ad00) 00010000:00010000:3.0:1787779632.682373:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787779632.682378:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af6889716 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.682395:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af6889716 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779632.682466:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e851683480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+49:10545:x1874622505077888:12345-192.168.201.9@tcp:54:lfs.0 Request processed in 272us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779632.682474:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 103 00000100:00100000:3.0:1787779632.684534:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779632.684617:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505078144 00000100:00100000:2.0:1787779632.684627:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505078144 00000100:00100000:2.0:1787779632.684695:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 28 00000100:00100000:2.0:1787779632.684759:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e852b9cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+49:10545:x1874622505078144:12345-192.168.201.9@tcp:35:lfs.0 00000100:00100000:2.0:1787779632.685012:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e852b9cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+50:10545:x1874622505078144:12345-192.168.201.9@tcp:35:lfs.0 Request processed in 256us (491us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1787779632.685021:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 28 00000001:00080000:0.0:1787779632.688393:0:7634:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:0.0:1787779632.688413:0:7634:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00010000:00010000:0.0:1787779632.755023:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779632.794327:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779632.799192:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505078400 00000100:00100000:0.0:1787779632.799208:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505078400 00000100:00100000:0.0:1787779632.799328:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 104 00000100:00100000:0.0:1787779632.799369:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e88195fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+50:10555:x1874622505078400:12345-192.168.201.9@tcp:101:bash.0 00010000:00010000:0.0:1787779632.799401:0:8197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787779632.799404:0:8197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787779632.799432:0:8197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889698 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad7c expref: 50 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.799452:0:8197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98e87450a200) 00010000:00010000:0.0:1787779632.799458:0:8197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787779632.799471:0:8197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68e00/0x9e63ba8af688971d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedad9f expref: -99 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.799570:0:8197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af6889724 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.799585:0:8197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af6889724 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.799597:0:8197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af6889724 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787779632.799608:0:8197:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787779632.799830:0:8197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68e00/0x9e63ba8af688971d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad9f expref: 52 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.799845:0:8197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af6889724 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad9f expref: 51 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.799853:0:8197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98e87450ad00) 00010000:00010000:0.0:1787779632.799856:0:8197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787779632.799865:0:8197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e848f69200, rc 0) 00000100:00100000:0.0:1787779632.799937:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e88195fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+51:10555:x1874622505078400:12345-192.168.201.9@tcp:101:bash.0 Request processed in 570us (5619us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1787779632.799945:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 104 00000100:00100000:2.0:1787779632.806320:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779632.806416:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505078656 00000100:00100000:3.0:1787779632.806427:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505078656 00000100:00100000:3.0:1787779632.806490:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 105 00000100:00100000:3.0:1787779632.806500:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e855b3d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+51:10555:x1874622505078656:12345-192.168.201.9@tcp:36:bash.0 00010000:00010000:3.0:1787779632.806567:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1787779632.806595:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af6889724 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad9f expref: 51 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.806616:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67400/0x9e63ba8af6889708 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad98 expref: 50 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.806627:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98e87450ad00) 00010000:00010000:3.0:1787779632.806632:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787779632.807019:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af6889732 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.807034:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af6889732 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.807044:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af6889732 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787779632.807110:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:3.0:1787779632.807137:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cb4c58ec reply state 00000000c67db66f transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af6889732 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779632.807147:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787779632.807288:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e855b3d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+52:10555:x1874622505078656:12345-192.168.201.9@tcp:36:bash.0 Request processed in 788us (977us total) trans 4294967394 rc 0/0 00000100:00100000:3.0:1787779632.807296:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 105 00000020:00080000:3.0:1787779632.807302:0:5837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787779632.822376:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779632.823358:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505078784 00000100:00100000:0.0:1787779632.823371:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505078784 00000100:00100000:0.0:1787779632.823443:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 106 00000100:00100000:0.0:1787779632.823454:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a7083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+52:10555:x1874622505078784:12345-192.168.201.9@tcp:101:bash.0 00010000:00010000:0.0:1787779632.823484:0:8197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787779632.823510:0:8197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68400/0x9e63ba8af6889739 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedada6 expref: -99 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.823617:0:8197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68a00/0x9e63ba8af6889740 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.823632:0:8197:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af6889732 lrc: 2/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.823640:0:8197:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68a00/0x9e63ba8af6889740 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.823661:0:8197:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af6889732 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.823683:0:8197:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68a00/0x9e63ba8af6889740 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.824004:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af6889732 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.824015:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af6889732 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.824022:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af6889732 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.824030:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e8429d4e00 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:3.0:1787779632.824034:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af6889732 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.824043:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af6889732 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.824059:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98e87450ad00) 00010000:00010000:3.0:1787779632.824062:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779632.824066:0:3290:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68a00/0x9e63ba8af6889740 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.824074:0:3290:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68a00/0x9e63ba8af6889740 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.824099:0:3290:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68a00/0x9e63ba8af6889740 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.824131:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af6889732 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.824139:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af6889732 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.824214:0:8197:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68a00/0x9e63ba8af6889740 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.824221:0:8197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68a00/0x9e63ba8af6889740 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787779632.824260:0:8197:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787779632.824265:0:8197:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787779632.824284:0:8197:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68a00/0x9e63ba8af6889740 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.824313:0:8197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68400/0x9e63ba8af6889739 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedada6 expref: 53 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.824327:0:8197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68a00/0x9e63ba8af6889740 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedada6 expref: 52 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.824334:0:8197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98e87450ad00) 00010000:00010000:0.0:1787779632.824347:0:8197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787779632.824351:0:8197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e848f68a00, rc 0) 00000100:00100000:0.0:1787779632.824421:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a7083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+52:10555:x1874622505078784:12345-192.168.201.9@tcp:101:bash.0 Request processed in 969us (2059us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779632.824430:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 106 00000100:00100000:0.0:1787779632.827120:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779632.827361:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505079040 00000100:00100000:3.0:1787779632.827372:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505079040 00000100:00100000:3.0:1787779632.827445:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 29 00000100:00100000:3.0:1787779632.827455:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+52:10555:x1874622505079040:12345-192.168.201.9@tcp:35:bash.0 00000100:00100000:3.0:1787779632.828929:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+53:10555:x1874622505079040:12345-192.168.201.9@tcp:35:bash.0 Request processed in 1466us (1812us total) trans 4294967395 rc 0/0 00000100:00100000:3.0:1787779632.828940:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 29 00000100:00100000:3.0:1787779632.921634:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779632.921765:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505079168 00000100:00100000:1.0:1787779632.921777:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505079168 00000100:00100000:1.0:1787779632.921852:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 107 00000100:00100000:1.0:1787779632.921862:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ab37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+53:10562:x1874622505079168:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:1.0:1787779632.921887:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779632.921910:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af6889747 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedadad expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779632.922003:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af688974e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779632.922018:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af688974e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779632.922030:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af688974e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787779632.922091:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:1.0:1787779632.922094:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787779632.922119:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af688974e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779632.922144:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af6889747 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedadad expref: 55 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779632.922163:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af688974e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedadad expref: 54 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779632.922172:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98e87450a200) 00010000:00010000:1.0:1787779632.922176:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787779632.922180:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87a98a400, rc 0) 00000100:00100000:1.0:1787779632.922244:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ab37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+54:10562:x1874622505079168:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 383us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779632.922252:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 107 00000100:00100000:1.0:1787779632.938867:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779632.938995:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505079296 00000100:00100000:0.0:1787779632.939005:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505079296 00000100:00100000:0.0:1787779632.939066:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 108 00000100:00100000:0.0:1787779632.939077:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a708b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+54:10562:x1874622505079296:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:0.0:1787779632.939099:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787779632.939119:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68e00/0x9e63ba8af6889755 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedadb4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.939180:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af688975c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.939207:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af688975c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.939219:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af688975c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.939234:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af6889763 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.939242:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af6889763 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.939248:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af6889763 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.939353:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af688976a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.939362:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af688976a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.939370:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af688976a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787779632.939403:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787779632.939407:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787779632.939423:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af688976a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.939435:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af688976a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.939454:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af688975c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.939461:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af688975c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.939468:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af688975c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.939474:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e848f68200 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:0.0:1787779632.939478:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af688975c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.939486:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af688975c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.939498:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98e87450a200) 00010000:00010000:0.0:1787779632.939500:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787779632.939505:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af688975c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.939510:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af688975c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.939523:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af6889763 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.939530:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af6889763 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.939537:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af6889763 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.939547:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e848f69800 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:0.0:1787779632.939551:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af6889763 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.939558:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af6889763 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.939565:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98e860e78300) 00010000:00010000:0.0:1787779632.939568:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787779632.939571:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af6889763 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.939578:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af6889763 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.939606:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68e00/0x9e63ba8af6889755 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedadb4 expref: 56 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.939618:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af688976a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedadb4 expref: 55 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.939625:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98e87450ad00) 00010000:00010000:0.0:1787779632.939628:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787779632.939631:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e848f68000, rc 0) 00000100:00100000:0.0:1787779632.939702:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a708b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+55:10562:x1874622505079296:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 627us (845us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779632.939769:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 108 00000100:00100000:0.0:1787779632.942758:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779632.942805:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779632.942908:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505079552 00000100:00100000:1.0:1787779632.942924:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505079552 00000100:00100000:1.0:1787779632.942988:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 109 00000100:00100000:1.0:1787779632.942998:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87aa30b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+55:10562:x1874622505079552:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:1.0:1787779632.943019:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779632.943041:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af6889771 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedadbb expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779632.943142:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889778 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779632.943157:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68a00/0x9e63ba8af6889740 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedada6 expref: 56 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779632.943166:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af688976a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedadb4 expref: 56 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779632.943174:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889778 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779632.943208:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af688976a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedadb4 expref: 56 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779632.943223:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af688976a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedadb4 expref: 56 pid: 5836 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779632.943236:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87aa57840 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5837:1874622525020928:192.168.201.9@tcp:104: 00010000:00010000:1.0:1787779632.943348:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68a00/0x9e63ba8af6889740 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedada6 expref: 56 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779632.943369:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68a00/0x9e63ba8af6889740 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedada6 expref: 56 pid: 8197 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779632.943380:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87aa561c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5837:1874622525021056:192.168.201.9@tcp:104: 00000100:00100000:1.0:1787779632.943405:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e84975f780 going to sleep for 11 seconds 00010000:00010000:1.0:1787779632.947363:0:5837:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.201.9@tcp) returned -22 from blocking AST (req@0000000079957e5a x1874622525020928) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af688976a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedadb4 expref: 56 pid: 5836 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779632.947392:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af688976a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedadb4 expref: 56 pid: 5836 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779632.947418:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af688976a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedadb4 expref: 56 pid: 5836 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779632.947435:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87aa57840 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5837:1874622525020928:192.168.201.9@tcp:104: 00000100:00100000:2.0:1787779632.949013:0:11162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505079680 00000100:00100000:2.0:1787779632.949027:0:11162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505079680 00000100:00100000:2.0:1787779632.949105:0:11162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 7 00000100:00100000:2.0:1787779632.949118:0:11162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87aa30780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+56:2358:x1874622505079680:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787779632.949136:0:11162:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787779632.949139:0:11162:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 9e63ba8af688976a) 00010000:00010000:2.0:1787779632.949141:0:11162:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787779632.949196:0:11162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87aa30780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+56:2358:x1874622505079680:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 82us (6391us total) trans 0 rc 116/116 00000100:00100000:2.0:1787779632.949204:0:11162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 7 00000100:00100000:1.0:1787779632.975787:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87aa561c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5837:1874622525021056:192.168.201.9@tcp:104: 00010000:00010000:1.0:1787779632.975820:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98e87450ad00) 00010000:00010000:1.0:1787779632.975828:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889778 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779632.975840:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889778 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779632.975849:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889778 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779632.976241:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779632.976398:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505079808 00000100:00100000:2.0:1787779632.976406:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505079808 00010000:00010000:2.0:1787779632.976443:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68a00/0x9e63ba8af6889740 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedada6 expref: 56 pid: 8197 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779632.976483:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 52 00000100:00100000:2.0:1787779632.976493:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ab36940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+56:2357:x1874622505079808:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787779632.976509:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787779632.976515:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68a00/0x9e63ba8af6889740 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedada6 expref: 56 pid: 8197 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779632.976541:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68a00/0x9e63ba8af6889740 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedada6 expref: 56 pid: 8197 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779632.976566:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68a00/0x9e63ba8af6889740 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedada6 expref: 56 pid: 8197 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779632.976581:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98e87450ad00) 00010000:00010000:2.0:1787779632.976585:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889778 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779632.976593:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889778 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779632.976601:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889778 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779632.976632:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787779632.976683:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ab36940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+55:2357:x1874622505079808:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 191us (442us total) trans 0 rc 0/0 00010000:00010000:3.0:1787779632.976685:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889778 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779632.976691:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 52 00010000:00010000:3.0:1787779632.976693:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889778 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787779632.976748:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1787779632.976899:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af6889771 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedadbb expref: 56 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.976915:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889778 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedadbb expref: 55 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.976929:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98e87450ad00) 00010000:00010000:3.0:1787779632.976931:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787779632.976934:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87a98ae00, rc 0) 00000100:00100000:3.0:1787779632.976962:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87aa30b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+55:10562:x1874622505079552:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 33965us (34212us total) trans 4294967396 rc 0/0 00000100:00100000:3.0:1787779632.976969:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 109 00000100:00100000:0.0:1787779632.982888:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779632.982970:0:11162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505080064 00000100:00100000:2.0:1787779632.982981:0:11162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505080064 00000100:00100000:2.0:1787779632.983049:0:11162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 8 00000100:00100000:2.0:1787779632.983059:0:11162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f53bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+55:10562:x1874622505080064:12345-192.168.201.9@tcp:103:lfs.0 00010000:00010000:2.0:1787779632.983075:0:11162:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787779632.983100:0:11162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af68896d7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad91 expref: 55 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779632.983139:0:11162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98e87450ad00) 00010000:00010000:2.0:1787779632.983144:0:11162:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787779632.983205:0:11162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f53bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+54:10562:x1874622505080064:12345-192.168.201.9@tcp:103:lfs.0 Request processed in 147us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779632.983212:0:11162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 8 00000100:00100000:1.0:1787779632.985203:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779632.985307:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505080192 00000100:00100000:0.0:1787779632.985318:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505080192 00000100:00100000:0.0:1787779632.985375:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 110 00000100:00100000:0.0:1787779632.985384:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87aa561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+54:10562:x1874622505080192:12345-192.168.201.9@tcp:58:lfs.0 00010000:00010000:0.0:1787779632.985487:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af6889786 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.985505:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af6889786 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779632.985517:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af6889786 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787779632.988293:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:0.0:1787779632.988432:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87aa561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+54:10562:x1874622505080192:12345-192.168.201.9@tcp:58:lfs.0 Request processed in 3043us (3232us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779632.988444:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 110 00000100:00100000:0.0:1787779632.998637:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779632.998775:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505080320 00000100:00100000:3.0:1787779632.998785:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505080320 00000100:00100000:3.0:1787779632.998851:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 111 00000100:00100000:3.0:1787779632.998862:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f53ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+54:10562:x1874622505080320:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:3.0:1787779632.998884:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779632.998906:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af688978d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedadc2 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.998968:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af6889786 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.998979:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af688978d lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedadc2 expref: 55 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.998999:0:5835:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af6889786 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.999013:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af688978d lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedadc2 expref: 55 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.999028:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98e87450ad00) 00010000:00010000:3.0:1787779632.999047:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787779632.999052:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af688978d lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedadc2 expref: 55 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779632.999063:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e8429d4e00, rc 0) 00000100:00100000:3.0:1787779632.999121:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f53ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+55:10562:x1874622505080320:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 261us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779632.999129:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 111 00000100:00100000:1.0:1787779633.075748:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ece6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622525021184:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787779633.075829:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779633.076044:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525021184 00000100:00100000:0.0:1787779633.076053:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525021184 00000100:00100000:0.0:1787779633.076104:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787779633.076112:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a89c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622525021184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787779633.076134:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3855613952 00000100:00100000:0.0:1787779633.076176:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a89c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622525021184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779633.076181:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787779633.076484:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:1.0:1787779633.076489:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967303 00000004:00080000:1.0:1787779633.076505:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98e874222d00, transno 4294967301 00000004:00080000:1.0:1787779633.076517:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967303 00000100:00100000:1.0:1787779633.076539:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ece6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622525021184:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787779633.779027:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787779633.843121:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787779633.843131:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787779633.843166:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1787779633.843178:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787779633.843276:0:11684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87aa57840 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11684:1874622525021312:192.168.201.9@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787779633.843379:0:11684:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e84975f240 going to sleep for 11 seconds 00000100:00100000:0.0:1787779633.848697:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779633.851798:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505080448 00000100:00100000:2.0:1787779633.851812:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505080448 00000100:00100000:2.0:1787779633.851880:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 112 00000100:00100000:2.0:1787779633.851889:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ece4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+56:10563:x1874622505080448:12345-192.168.201.9@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787779633.851922:0:5836:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787779633.852043:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ece4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+56:10563:x1874622505080448:12345-192.168.201.9@tcp:53:lhsmtool_posix.0 Request processed in 155us (3355us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779633.852051:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 112 00000100:00100000:1.0:1787779633.853651:0:11684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87aa57840 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11684:1874622525021312:192.168.201.9@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787779633.856333:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779633.856382:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505080576 00000100:00100000:3.0:1787779633.856392:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505080576 00000100:00100000:3.0:1787779633.856443:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 113 00000100:00100000:3.0:1787779633.856449:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ece7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+55:10563:x1874622505080576:12345-192.168.201.9@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787779633.856511:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5400/0x9e63ba8af6889794 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779633.856524:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5400/0x9e63ba8af6889794 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779633.856532:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5400/0x9e63ba8af6889794 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779633.856579:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af688979b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779633.856585:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af688979b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779633.856588:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af688979b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779633.856606:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af68897a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779633.856625:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af68897a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779633.856630:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af68897a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787779633.856672:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1787779633.856676:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787779633.856685:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af68897a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779633.856694:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5400/0x9e63ba8af6889794 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779633.856699:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5400/0x9e63ba8af6889794 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779633.856946:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5400/0x9e63ba8af6889794 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779633.856953:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e8429d5400 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:3.0:1787779633.856958:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5400/0x9e63ba8af6889794 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779633.856965:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5400/0x9e63ba8af6889794 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779633.856977:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98e84927fc00) 00010000:00010000:3.0:1787779633.856979:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779633.856984:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5400/0x9e63ba8af6889794 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779633.857000:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5400/0x9e63ba8af6889794 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779633.857014:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af688979b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779633.857020:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af688979b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779633.857026:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af688979b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779633.857031:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e8429d4000 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:3.0:1787779633.857034:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af688979b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779633.857040:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af688979b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779633.857046:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff98e87450af00) 00010000:00010000:3.0:1787779633.857049:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779633.857051:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af688979b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779633.857056:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af688979b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779633.857071:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af68897a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779633.857082:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af68897a2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779633.857093:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af68897a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779633.857098:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e8429d4400 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:3.0:1787779633.857101:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af68897a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779633.857107:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af68897a2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779633.857115:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98e87450ad00) 00010000:00010000:3.0:1787779633.857118:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779633.857120:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af68897a2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779633.857126:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af68897a2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779633.857206:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ece7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+55:10563:x1874622505080576:12345-192.168.201.9@tcp:34:lhsmtool_posix.0 Request processed in 756us (888us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779633.857216:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 113 00000100:00100000:0.0:1787779633.860560:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779633.860667:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505080832 00000100:00100000:3.0:1787779633.860676:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505080832 00000100:00100000:3.0:1787779633.860769:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 114 00000100:00100000:3.0:1787779633.860779:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ece61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+55:10563:x1874622505080832:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787779633.860801:0:8197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779633.860822:0:8197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af68897a9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedadc9 expref: -99 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779633.860935:0:8197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af68897b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779633.860949:0:8197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af68897b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779633.860959:0:8197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af68897b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787779633.860969:0:8197:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1787779633.861256:0:8197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af68897b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779633.861264:0:8197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af68897b0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779633.861271:0:8197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af68897b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779633.861276:0:8197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e8429d5000 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:3.0:1787779633.861280:0:8197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af68897b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779633.861287:0:8197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af68897b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779633.861299:0:8197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98e87450ad00) 00010000:00010000:3.0:1787779633.861302:0:8197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787779633.861305:0:8197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af68897b0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779633.861320:0:8197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af68897b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779633.861363:0:8197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af68897a9 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedadc9 expref: 57 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779633.861374:0:8197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98e84927fc00) 00010000:00010000:3.0:1787779633.861376:0:8197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787779633.861380:0:8197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af68897a9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedadc9 expref: 57 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779633.861389:0:8197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e8429d5c00, rc 0) 00000100:00100000:3.0:1787779633.861482:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ece61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+56:10563:x1874622505080832:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 Request processed in 704us (930us total) trans 4294967397 rc 301/301 00000100:00100000:3.0:1787779633.861490:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 114 00000100:00100000:0.0:1787779633.864414:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779633.864477:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505080960 00000100:00100000:3.0:1787779633.864486:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505080960 00000100:00100000:3.0:1787779633.864549:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 115 00000100:00100000:3.0:1787779633.864559:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ece7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+56:10563:x1874622505080960:12345-192.168.201.9@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787779633.864595:0:5837:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787779633.865248:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ece7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+56:10563:x1874622505080960:12345-192.168.201.9@tcp:53:lhsmtool_posix.0 Request processed in 687us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779633.865258:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 115 00000100:00100000:0.0:1787779633.870227:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779633.870494:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505081216 00000100:00100000:1.0:1787779633.870506:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505081216 00000100:00100000:1.0:1787779633.870594:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 116 00000100:00100000:1.0:1787779633.870604:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ece4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+56:10563:x1874622505081216:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787779633.870625:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779633.870628:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787779633.870665:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af688974e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedadad expref: 56 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779633.870683:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98e87450a200) 00010000:00010000:1.0:1787779633.870701:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787779633.870747:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af68897be lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedadd0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787779633.871447:0:5836:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:1.0:1787779633.871768:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b800/0x9e63ba8af68897c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779633.871782:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b800/0x9e63ba8af68897c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779633.872015:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b800/0x9e63ba8af68897c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779633.872076:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af68897be lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedadd0 expref: 58 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779633.872094:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b800/0x9e63ba8af68897c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedadd0 expref: 57 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779633.872103:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98e860c40500) 00010000:00010000:1.0:1787779633.872105:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787779633.872108:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87a98b800, rc 0) 00000100:00100000:1.0:1787779633.872180:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ece4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+57:10563:x1874622505081216:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 Request processed in 1577us (1962us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1787779633.872189:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 116 00000100:00100000:0.0:1787779633.880625:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779633.881195:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505081472 00000100:00100000:2.0:1787779633.881206:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505081472 00000100:00100000:2.0:1787779633.881265:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 117 00000100:00100000:2.0:1787779633.881277:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ece6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+57:10563:x1874622505081472:12345-192.168.201.9@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787779633.881353:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787779633.881382:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b800/0x9e63ba8af68897c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedadd0 expref: 57 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779633.881403:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98e860c40500) 00010000:00010000:2.0:1787779633.881414:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787779633.881435:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67200/0x9e63ba8af68897d3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779633.881463:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67200/0x9e63ba8af68897d3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779633.881474:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67200/0x9e63ba8af68897d3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779633.882138:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67600/0x9e63ba8af68897da lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xb6e1996e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779633.882149:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67600/0x9e63ba8af68897da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xb6e1996e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779633.882157:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67600/0x9e63ba8af68897da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xb6e1996e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779633.882237:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67200/0x9e63ba8af68897d3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779633.882244:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67200/0x9e63ba8af68897d3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779633.882251:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67200/0x9e63ba8af68897d3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779633.882256:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87aa67200 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:2.0:1787779633.882260:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67200/0x9e63ba8af68897d3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779633.882267:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67200/0x9e63ba8af68897d3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779633.882275:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98e87450a200) 00010000:00010000:2.0:1787779633.882284:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787779633.882288:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67200/0x9e63ba8af68897d3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779633.882294:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67200/0x9e63ba8af68897d3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779633.882305:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67600/0x9e63ba8af68897da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xb6e1996e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779633.882310:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67600/0x9e63ba8af68897da lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb6e1996e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779633.882316:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67600/0x9e63ba8af68897da lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb6e1996e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779633.882329:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87aa67600 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:2.0:1787779633.882332:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67600/0x9e63ba8af68897da lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb6e1996e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779633.882337:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67600/0x9e63ba8af68897da lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb6e1996e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779633.882343:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xb6e1996e (ffff98e84927fa00) 00010000:00010000:2.0:1787779633.882346:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787779633.882348:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67600/0x9e63ba8af68897da lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xb6e1996e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779633.882354:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67600/0x9e63ba8af68897da lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xb6e1996e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779633.882538:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ece6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+56:10563:x1874622505081472:12345-192.168.201.9@tcp:36:lhsmtool_posix.0 Request processed in 1261us (1921us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787779633.882551:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 117 00000100:00100000:0.0:1787779633.890130:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779633.890211:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505081600 00000100:00100000:3.0:1787779633.890221:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505081600 00000100:00100000:3.0:1787779633.890406:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 118 00000100:00100000:3.0:1787779633.890426:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ece6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+56:10563:x1874622505081600:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787779633.890445:0:8197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779633.890464:0:8197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af68897e1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedadd7 expref: -99 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779633.890495:0:8197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af68897e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779633.890510:0:8197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af68897e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779633.890521:0:8197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af68897e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779633.890612:0:8197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af68897e1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedadd7 expref: 58 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779633.890626:0:8197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af68897e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedadd7 expref: 57 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779633.890632:0:8197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98e87450af00) 00010000:00010000:3.0:1787779633.890634:0:8197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787779633.890636:0:8197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e8429d5000, rc 0) 00000100:00100000:3.0:1787779633.890689:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ece6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+57:10563:x1874622505081600:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 Request processed in 263us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779633.890693:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 118 00000100:00100000:0.0:1787779633.893134:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779633.893256:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505081856 00000100:00100000:2.0:1787779633.893266:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505081856 00000100:00100000:2.0:1787779633.893330:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 119 00000100:00100000:2.0:1787779633.893338:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ece43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+57:10563:x1874622505081856:12345-192.168.201.9@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787779633.893415:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67000/0x9e63ba8af68897ef lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779633.893429:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67000/0x9e63ba8af68897ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779633.893438:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67000/0x9e63ba8af68897ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787779633.893764:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:2.0:1787779633.893775:0:5835:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 399635062387ns, next at 400635059722ns, rc = 0 00000004:00010000:2.0:1787779633.893856:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000020fc1f3d reply state 000000002b43f9f3 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67000/0x9e63ba8af68897ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779633.893863:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787779633.894048:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ece43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+59:10563:x1874622505081856:12345-192.168.201.9@tcp:36:lhsmtool_posix.0 Request processed in 710us (924us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1787779633.894053:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 119 00010000:00010000:3.0:1787779633.899406:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67000/0x9e63ba8af68897ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779633.899440:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67000/0x9e63ba8af68897ef lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779633.899448:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67000/0x9e63ba8af68897ef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779633.899454:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87aa67000 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:3.0:1787779633.899459:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67000/0x9e63ba8af68897ef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779633.899467:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67000/0x9e63ba8af68897ef lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779633.899483:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98e87450af00) 00010000:00010000:3.0:1787779633.899693:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787779633.899700:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67000/0x9e63ba8af68897ef lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779633.899732:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67000/0x9e63ba8af68897ef lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779633.899783:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779633.899914:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505081984 00000100:00100000:1.0:1787779633.899923:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505081984 00000100:00100000:1.0:1787779633.899968:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 120 00000100:00100000:1.0:1787779633.899978:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ece6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+58:10563:x1874622505081984:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787779633.900007:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779633.900023:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af68897f6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedadde expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779633.900072:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af68897f6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedadde expref: 59 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779633.900081:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af68897f6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedadde expref: 59 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779633.900094:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98e87450af00) 00010000:00010000:1.0:1787779633.900096:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787779633.900099:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87a98a600, rc 0) 00000100:00100000:1.0:1787779633.900183:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ece6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+59:10563:x1874622505081984:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 Request processed in 208us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779633.900188:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 120 00000100:00100000:0.0:1787779633.901942:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779633.902023:0:10229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505082112 00000100:00100000:2.0:1787779633.902030:0:10229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505082112 00000100:00100000:2.0:1787779633.902115:0:10229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 38 00000100:00100000:2.0:1787779633.902123:0:10229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87aa312c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+8:2360:x1874622505082112:12345-192.168.201.9@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787779633.902394:0:10229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87aa312c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+9:2360:x1874622505082112:12345-192.168.201.9@tcp:2:lhsmtool_posix.0 Request processed in 272us (457us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1787779633.902412:0:10229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 38 00000100:00080000:1.0:1787779633.902981:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787779633.907933:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779633.907973:0:11475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505082368 00000100:00100000:3.0:1787779633.907983:0:11475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505082368 00000100:00100000:3.0:1787779633.908040:0:11475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 30 00000100:00100000:3.0:1787779633.908051:0:11475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87aa32940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+59:10563:x1874622505082368:12345-192.168.201.9@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787779633.908400:0:11475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87aa32940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+60:10563:x1874622505082368:12345-192.168.201.9@tcp:35:lhsmtool_posix.0 Request processed in 351us (477us total) trans 4294967400 rc 0/0 00000100:00100000:3.0:1787779633.908407:0:11475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 30 00000100:00100000:0.0:1787779633.909957:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779633.910028:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505082624 00000100:00100000:1.0:1787779633.910035:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505082624 00000100:00100000:1.0:1787779633.910082:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 121 00000100:00100000:1.0:1787779633.910092:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87aa30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+60:10563:x1874622505082624:12345-192.168.201.9@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787779633.910193:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87aa30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+60:10563:x1874622505082624:12345-192.168.201.9@tcp:57:lhsmtool_posix.0 Request processed in 102us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779633.910201:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 121 00000100:00100000:0.0:1787779633.911464:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779633.911529:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505082752 00000100:00100000:3.0:1787779633.911549:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505082752 00000100:00100000:3.0:1787779633.911584:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 122 00000100:00100000:3.0:1787779633.911590:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87aa31e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+60:10563:x1874622505082752:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787779633.911603:0:8197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779633.911618:0:8197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af68897fd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedade5 expref: -99 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779633.912007:0:8197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67600/0x9e63ba8af6889804 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779633.912023:0:8197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67600/0x9e63ba8af6889804 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779633.912031:0:8197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67600/0x9e63ba8af6889804 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787779633.912061:0:8197:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787779633.912074:0:8197:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67600/0x9e63ba8af6889804 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779633.912097:0:8197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af68897fd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedade5 expref: 62 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779633.912114:0:8197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67600/0x9e63ba8af6889804 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedade5 expref: 61 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779633.912122:0:8197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98e87450af00) 00010000:00010000:2.0:1787779633.912125:0:8197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787779633.912128:0:8197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87aa67600, rc 0) 00000100:00100000:2.0:1787779633.912174:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87aa31e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+61:10563:x1874622505082752:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 Request processed in 584us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779633.912180:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 122 00000100:00100000:0.0:1787779633.918973:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779633.919069:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505082880 00000100:00100000:1.0:1787779633.919079:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505082880 00000100:00100000:1.0:1787779633.919144:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 39 00000100:00100000:1.0:1787779633.919167:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87aa321c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+9:2360:x1874622505082880:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787779633.919186:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779633.919205:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000807640ef/0x9e63ba8af688980b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedadec expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787779633.919231:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8f5a31, blocks: 0x1 00010000:00010000:1.0:1787779633.919249:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=399s v=(0 0) 00010000:00010000:1.0:1787779633.919254:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787779633.919264:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000807640ef/0x9e63ba8af688980b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedadec expref: 10 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779633.919280:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000807640ef/0x9e63ba8af688980b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedadec expref: 10 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779633.919295:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87a98a400, rc 0) 00000100:00100000:1.0:1787779633.919460:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87aa321c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+10:2360:x1874622505082880:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 Request processed in 294us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779633.919468:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 39 00000100:00100000:0.0:1787779633.921671:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779633.921814:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505083136 00000100:00100000:1.0:1787779633.921826:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505083136 00000100:00100000:1.0:1787779633.922055:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 123 00000100:00100000:1.0:1787779633.922068:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a709680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+61:10563:x1874622505083136:12345-192.168.201.9@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787779633.922298:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a709680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+61:10563:x1874622505083136:12345-192.168.201.9@tcp:57:lhsmtool_posix.0 Request processed in 232us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779633.922306:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 123 00000100:00100000:0.0:1787779633.928958:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779633.929089:0:10229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505083264 00000100:00100000:2.0:1787779633.929099:0:10229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505083264 00000100:00100000:2.0:1787779633.929188:0:10229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 40 00000100:00100000:2.0:1787779633.929214:0:10229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a708780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+10:10563:x1874622505083264:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787779633.929234:0:10229:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779633.929251:0:10229:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000035afe464/0x9e63ba8af6889812 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedadf3 expref: -99 pid: 10229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779633.929284:0:10229:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000807640ef/0x9e63ba8af688980b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedadec expref: 11 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779633.929294:0:10229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787779633.929299:0:10229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787779633.929305:0:10229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035afe464/0x9e63ba8af6889812 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedadf3 expref: 11 pid: 10229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779633.929339:0:10229:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000807640ef/0x9e63ba8af688980b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedadec expref: 11 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779633.929353:0:10229:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000807640ef/0x9e63ba8af688980b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedadec expref: 11 pid: 6682 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779633.929369:0:10229:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855b3d680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10229:1874622525021440:192.168.201.9@tcp:104: 00000100:00100000:2.0:1787779633.929466:0:10229:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e8521e0b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787779633.931640:0:10229:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855b3d680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10229:1874622525021440:192.168.201.9@tcp:104: 00010000:00010000:2.0:1787779633.931679:0:10229:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000035afe464/0x9e63ba8af6889812 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedadf3 expref: 11 pid: 10229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779633.931819:0:10229:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87aa67200, rc 0) 00000100:00100000:2.0:1787779633.931892:0:10229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a708780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+11:10563:x1874622505083264:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 Request processed in 2677us (2940us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779633.931903:0:10229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 40 00000100:00100000:0.0:1787779633.933131:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779633.933241:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505083392 00000100:00100000:2.0:1787779633.933249:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505083392 00010000:00010000:2.0:1787779633.933287:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000807640ef/0x9e63ba8af688980b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedadec expref: 11 pid: 6682 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779633.933392:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 53 00000100:00100000:2.0:1787779633.933400:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e847d96450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+11:2359:x1874622505083392:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787779633.933412:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787779633.933434:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000807640ef/0x9e63ba8af688980b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedadec expref: 11 pid: 6682 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779633.933444:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000807640ef/0x9e63ba8af688980b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedadec expref: 11 pid: 6682 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779633.933465:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000807640ef/0x9e63ba8af688980b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedadec expref: 11 pid: 6682 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779633.933476:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787779633.933488:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787779633.933494:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000035afe464/0x9e63ba8af6889812 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedadf3 expref: 10 pid: 10229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779633.933513:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035afe464/0x9e63ba8af6889812 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedadf3 expref: 10 pid: 10229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779633.933540:0:5822:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000035afe464/0x9e63ba8af6889812 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedadf3 expref: 10 pid: 10229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779633.933550:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855b3d680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5822:1874622525021568:192.168.201.9@tcp:105: 00000100:00100000:2.0:1787779633.933612:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e8521e0b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787779633.936908:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779633.936910:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855b3d680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5822:1874622525021568:192.168.201.9@tcp:105: 00010000:00010000:2.0:1787779633.936933:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787779633.936991:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e847d96450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+10:2359:x1874622505083392:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 3590us (3865us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779633.937003:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 53 00000100:00100000:0.0:1787779633.937228:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505083520 00000100:00100000:0.0:1787779633.937235:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505083520 00002000:00100000:0.0:1787779633.937279:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff98e87aa57840 x1874622505083520/t0(0) o4->e225400f-8d32-48a8-ab5e-fe4d3780a20c@192.168.201.9@tcp:44/0 lens 504/0 e 0 to 0 dl 1787779644 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787779633.937289:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98e87aa57840 with x1874622505083520 ext(0->12) 00002000:00010000:0.0:1787779633.937294:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98e87aa57840 00000100:00100000:0.0:1787779633.937396:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 3 00000100:00100000:0.0:1787779633.937403:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87aa57840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+10:2360:x1874622505083520:12345-192.168.201.9@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787779633.937925:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87aa57840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+12:2360:x1874622505083520:12345-192.168.201.9@tcp:4:lhsmtool_posix.0 Request processed in 521us (1025us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1787779633.937931:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 3 00002000:00100000:0.0:1787779633.937941:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff98e87aa57840 x1874622505083520/t4294967308(0) o4->e225400f-8d32-48a8-ab5e-fe4d3780a20c@192.168.201.9@tcp:44/0 lens 504/448 e 0 to 0 dl 1787779644 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787779633.937947:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98e87aa57840 with x1874622505083520 ext(0->12) 00002000:00010000:0.0:1787779633.937949:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98e87aa57840 00000100:00100000:2.0:1787779633.945514:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779633.945942:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505083648 00000100:00100000:3.0:1787779633.945952:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505083648 00000100:00100000:3.0:1787779633.946014:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 124 00000100:00100000:3.0:1787779633.946024:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e855b3d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+61:10563:x1874622505083648:12345-192.168.201.9@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787779633.968837:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967392 is committed 00000100:00100000:3.0:1787779633.968919:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e855b3d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+58:10563:x1874622505083648:12345-192.168.201.9@tcp:44:lhsmtool_posix.0 Request processed in 22891us (23411us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779633.968930:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 124 00000001:00080000:1.0:1787779633.969790:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967398 is committed 00000001:00080000:1.0:1787779633.969807:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967399 is committed 00000004:00080000:1.0:1787779633.969811:0:5857:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:1.0:1787779633.969833:0:5857:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98e8521e0900 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1787779633.969837:0:5857:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98e85d887700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98e8521e0600 00000020:00080000:1.0:1787779633.969841:0:5857:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98e85d887f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98e87f4fd400 00000001:00080000:1.0:1787779633.969878:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:1.0:1787779633.969898:0:5857:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000004:00080000:1.0:1787779633.969915:0:5857:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:1.0:1787779633.969924:0:5857:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98e87eb420c0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1787779633.969927:0:5857:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98e87f009000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98e87eb42540 00000020:00080000:1.0:1787779633.969929:0:5857:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98e87f009b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98e87fd35c00 00000020:00080000:3.0:1787779633.969931:0:5868:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:3.0:1787779633.969934:0:5868:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000100:00100000:1.0:1787779633.969996:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87aa543c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874622525021696:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787779633.970047:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779633.970106:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525021696 00000100:00100000:1.0:1787779633.970113:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525021696 00000100:00100000:1.0:1787779633.970153:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787779633.970161:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87aa552c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874622525021696:12345-0@lo:6:osp-syn-1-0.0 00000020:00080000:3.0:1787779633.970166:0:5868:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00002000:00080000:1.0:1787779633.970186:0:6682:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:1.0:1787779633.970216:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a8f5a2f, atime: 0x0, ctime: 0x6a8f5a2f, blocks: 0xb 00010000:00010000:1.0:1787779633.970223:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005279aec9/0x9e63ba8af6889819 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779633.970238:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=399s v=(0 0) 00010000:00010000:1.0:1787779633.970255:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787779633.970262:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005279aec9/0x9e63ba8af6889819 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779633.970275:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87a7092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622525021952:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1787779633.970278:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005279aec9/0x9e63ba8af6889819 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779633.970288:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005279aec9/0x9e63ba8af6889819 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779633.970295:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005279aec9/0x9e63ba8af6889819 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779633.970303:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787779633.970311:0:6682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787779633.970400:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87a709e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874622525021824:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787779633.970426:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779633.970485:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525021952 00000100:00100000:0.0:1787779633.970490:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525021952 00000100:00100000:0.0:1787779633.970505:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525021824 00000100:00100000:0.0:1787779633.970508:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525021824 00000100:00100000:0.0:1787779633.970518:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787779633.970524:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a70b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3306:x1874622525021952:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1787779633.970618:0:6680:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787779633.970622:0:6680:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787779633 00002000:00010000:0.0:1787779633.970624:0:6680:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787779633.970626:0:6680:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1787779633 -> 1787779633 00002000:00010000:0.0:1787779633.970628:0:6680:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787779633.970768:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87aa552c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3304:x1874622525021696:12345-0@lo:6:osp-syn-1-0.0 Request processed in 606us (720us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1787779633.970775:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787779633.970790:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787779633.970796:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ab35680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3305:x1874622525021824:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787779633.970807:0:6682:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:1.0:1787779633.970818:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1b677ba/0x9e63ba8af6889820 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779633.970833:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000c4c5017/0x9e63ba8af68895db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad52 expref: 11 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779633.970841:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1787779633.970850:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787779633.970854:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a1b677ba/0x9e63ba8af6889820 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779633.970879:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000c4c5017/0x9e63ba8af68895db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad52 expref: 11 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779633.970893:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000c4c5017/0x9e63ba8af68895db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad52 expref: 11 pid: 6680 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779633.970904:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87aa54780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6682:1874622525022080:192.168.201.9@tcp:104: 00000100:00100000:1.0:1787779633.970960:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e8482150c0 going to sleep for 11 seconds 00010000:00010000:1.0:1787779633.970980:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787779633.970986:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005279aec9/0x9e63ba8af6889819 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779633.970993:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87a98b600 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:1.0:1787779633.970997:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005279aec9/0x9e63ba8af6889819 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779633.971006:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005279aec9/0x9e63ba8af6889819 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779633.971023:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005279aec9/0x9e63ba8af6889819 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779633.971031:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005279aec9/0x9e63ba8af6889819 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779633.971057:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779633.971060:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779633.971061:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787779633.971100:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98e87aa543c0/2, rc 0, transno 4294967304 00000100:00100000:1.0:1787779633.971107:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87aa543c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874622525021696:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787779633.971247:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a70b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3306:x1874622525021952:12345-0@lo:2:osp-syn-0-0.0 Request processed in 722us (942us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1787779633.971255:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000004:00080000:1.0:1787779633.971320:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98e87a7092c0/2, rc 0, transno 4294967309 00000100:00100000:1.0:1787779633.971326:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87a7092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622525021952:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787779633.972944:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779633.973036:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505083776 00000100:00100000:1.0:1787779633.973043:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505083776 00000100:00100000:1.0:1787779633.973083:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 44 00000100:00100000:3.0:1787779633.973218:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87aa54780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6682:1874622525022080:192.168.201.9@tcp:104: 00010000:00010000:3.0:1787779633.973238:0:6682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a1b677ba/0x9e63ba8af6889820 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779633.973285:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e855b3e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+12:2360:x1874622505083776:12345-192.168.201.9@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1787779633.975480:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779633.975532:0:11162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505083904 00000100:00100000:2.0:1787779633.975540:0:11162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505083904 00010000:00010000:2.0:1787779633.975573:0:11162:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000c4c5017/0x9e63ba8af68895db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad52 expref: 13 pid: 6680 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779633.975603:0:11162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 54 00000100:00100000:2.0:1787779633.975609:0:11162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87aa54780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+13:2358:x1874622505083904:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787779633.975619:0:11162:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787779633.975623:0:11162:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000c4c5017/0x9e63ba8af68895db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad52 expref: 13 pid: 6680 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779633.975640:0:11162:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000c4c5017/0x9e63ba8af68895db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad52 expref: 13 pid: 6680 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779633.975668:0:11162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c4c5017/0x9e63ba8af68895db lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad52 expref: 13 pid: 6680 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779633.975680:0:11162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787779633.975683:0:11162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787779633.975687:0:11162:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a1b677ba/0x9e63ba8af6889820 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779633.975695:0:11162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a1b677ba/0x9e63ba8af6889820 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779633.975755:0:11162:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787779633.975821:0:11162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87aa54780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+12:2358:x1874622505083904:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 210us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779633.975829:0:11162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 54 00010000:00010000:1.0:1787779633.976173:0:6682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a1b677ba/0x9e63ba8af6889820 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779633.976184:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a1b677ba/0x9e63ba8af6889820 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779633.976194:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1b677ba/0x9e63ba8af6889820 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779633.976202:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a1b677ba/0x9e63ba8af6889820 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779633.976251:0:6682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787779633.980400:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1787779633.980412:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ab35680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3305:x1874622525021824:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9611us (9980us total) trans 4294967310 rc 0/0 00010000:00010000:2.0:1787779633.980413:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a1b677ba/0x9e63ba8af6889820 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779633.980423:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00010000:2.0:1787779633.980427:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87a98b800 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:2.0:1787779633.980432:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1b677ba/0x9e63ba8af6889820 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779633.980456:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1b677ba/0x9e63ba8af6889820 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779633.980477:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a1b677ba/0x9e63ba8af6889820 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779633.980484:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a1b677ba/0x9e63ba8af6889820 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787779633.980484:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98e87a709e00/2, rc 0, transno 4294967310 00000100:00100000:1.0:1787779633.980490:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87a709e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874622525021824:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1787779633.980512:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779633.980514:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779633.980516:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787779634.012585:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:1.0:1787779634.012597:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:0.0:1787779634.012781:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e855b3e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:2360:x1874622505083776:12345-192.168.201.9@tcp:16:lhsmtool_posix.0 Request processed in 39684us (39837us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779634.012792:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 44 00000100:00100000:1.0:1787779634.015231:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779634.015340:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505084160 00000100:00100000:3.0:1787779634.015351:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505084160 00000100:00100000:3.0:1787779634.015423:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 125 00000100:00100000:3.0:1787779634.015454:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e874222d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+15:10563:x1874622505084160:12345-192.168.201.9@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787779634.015522:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787779634.015553:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67600/0x9e63ba8af6889804 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedade5 expref: 15 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779634.015573:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98e87450af00) 00010000:00010000:3.0:1787779634.015580:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787779634.015611:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af6889827 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779634.015625:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af6889827 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779634.015635:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af6889827 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787779634.015957:0:5836:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002446ef0c reply state 000000000ea3a2b8 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af6889827 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779634.015967:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787779634.016060:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e874222d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+16:10563:x1874622505084160:12345-192.168.201.9@tcp:36:lhsmtool_posix.0 Request processed in 611us (838us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1787779634.016068:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 125 00000100:00080000:1.0:1787779634.016445:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787779634.018670:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af6889827 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779634.018686:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af6889827 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779634.018694:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af6889827 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779634.018757:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e8429d4400 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:3.0:1787779634.018762:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af6889827 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779634.018770:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af6889827 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779634.018787:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98e87450af00) 00010000:00010000:3.0:1787779634.018790:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779634.018796:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af6889827 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779634.018802:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af6889827 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779634.024605:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779634.024756:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505084288 00000100:00100000:0.0:1787779634.024768:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505084288 00000100:00100000:0.0:1787779634.024828:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 45 00000100:00100000:0.0:1787779634.024838:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e874220780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:2359:x1874622505084288:12345-192.168.201.9@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787779634.025353:0:6680:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1787779634.025358:0:6680:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1787779633 -> 1787779632 00002000:00010000:0.0:1787779634.025361:0:6680:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787779631 00002000:00010000:0.0:1787779634.025363:0:6680:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1787779633 -> 1787779632 00002000:00010000:0.0:1787779634.025365:0:6680:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1787779634.025426:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e874220780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+7:2359:x1874622505084288:12345-192.168.201.9@tcp:2:lhsmtool_posix.0 Request processed in 588us (829us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1787779634.025434:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 45 00000100:00100000:1.0:1787779634.028978:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779634.029053:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505084544 00000100:00100000:2.0:1787779634.029063:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505084544 00000100:00100000:2.0:1787779634.029129:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 126 00000100:00100000:2.0:1787779634.029140:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f6b6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+15:10563:x1874622505084544:12345-192.168.201.9@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787779634.029207:0:8197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af688982e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779634.029225:0:8197:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af68897e8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedadd7 expref: 15 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779634.029234:0:8197:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af688982e lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779634.029269:0:8197:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af68897e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedadd7 expref: 15 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779634.029303:0:8197:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af68897e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedadd7 expref: 15 pid: 8197 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779634.029319:0:8197:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855b3cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8197:1874622525022208:192.168.201.9@tcp:104: 00000100:00100000:2.0:1787779634.029408:0:8197:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e8521e0840 going to sleep for 11 seconds 00000100:00100000:2.0:1787779634.032908:0:8197:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855b3cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8197:1874622525022208:192.168.201.9@tcp:104: 00010000:00010000:2.0:1787779634.032945:0:8197:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af688982e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779634.034154:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779634.034636:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505084672 00000100:00100000:0.0:1787779634.034913:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505084672 00010000:00010000:1.0:1787779634.035126:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af68897e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedadd7 expref: 16 pid: 8197 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779634.039131:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 55 00000100:00100000:1.0:1787779634.039158:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f6b6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+16:2359:x1874622505084672:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787779634.039181:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787779634.039194:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af68897e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedadd7 expref: 16 pid: 8197 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779634.039211:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af68897e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedadd7 expref: 16 pid: 8197 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779634.039256:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af68897e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedadd7 expref: 16 pid: 8197 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779634.039274:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98e87450af00) 00010000:00010000:1.0:1787779634.039279:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af688982e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779634.039288:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af688982e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779634.039295:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af688982e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779634.039846:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787779634.039976:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f6b6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+15:2359:x1874622505084672:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 829us (5828us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779634.039985:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 55 00010000:00010000:0.0:1787779634.041493:0:8197:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af688982e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779634.041509:0:8197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af688982e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779634.041541:0:8197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af688982e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779634.041549:0:8197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af688982e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779634.041556:0:8197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af688982e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779634.041562:0:8197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87aa66e00 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:0.0:1787779634.041566:0:8197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af688982e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779634.041573:0:8197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af688982e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779634.041605:0:8197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98e87450af00) 00010000:00010000:0.0:1787779634.041608:0:8197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787779634.041613:0:8197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af688982e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779634.041620:0:8197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af688982e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779634.041901:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f6b6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+14:10563:x1874622505084544:12345-192.168.201.9@tcp:55:lhsmtool_posix.0 Request processed in 12759us (12928us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787779634.041911:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 126 00000100:00100000:3.0:1787779634.044962:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779634.045039:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505084800 00000100:00100000:1.0:1787779634.045047:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505084800 00000100:00100000:1.0:1787779634.045098:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 46 00000100:00100000:1.0:1787779634.045107:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ab36d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+7:2360:x1874622505084800:12345-192.168.201.9@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787779634.045158:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005279aec9/0x9e63ba8af6889835 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779634.045176:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000035afe464/0x9e63ba8af6889812 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedadf3 expref: 7 pid: 10229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779634.045197:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787779634.045200:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787779634.045204:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005279aec9/0x9e63ba8af6889835 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779634.045234:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000035afe464/0x9e63ba8af6889812 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedadf3 expref: 7 pid: 10229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779634.045245:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000035afe464/0x9e63ba8af6889812 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedadf3 expref: 7 pid: 10229 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779634.045257:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f6b7840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6682:1874622525022336:192.168.201.9@tcp:104: 00000100:00100000:1.0:1787779634.045340:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e848215cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787779634.048674:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779634.049002:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f6b7840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6682:1874622525022336:192.168.201.9@tcp:104: 00010000:00010000:3.0:1787779634.049031:0:6682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005279aec9/0x9e63ba8af6889835 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779634.049261:0:11162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505084928 00000100:00100000:2.0:1787779634.049268:0:11162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505084928 00010000:00010000:2.0:1787779634.049325:0:11162:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000035afe464/0x9e63ba8af6889812 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedadf3 expref: 8 pid: 10229 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779634.049402:0:11162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 56 00000100:00100000:2.0:1787779634.049413:0:11162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f6b5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+8:2359:x1874622505084928:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787779634.049427:0:11162:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787779634.049450:0:11162:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000035afe464/0x9e63ba8af6889812 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedadf3 expref: 8 pid: 10229 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779634.049463:0:11162:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000035afe464/0x9e63ba8af6889812 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedadf3 expref: 8 pid: 10229 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779634.049486:0:11162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000035afe464/0x9e63ba8af6889812 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedadf3 expref: 8 pid: 10229 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779634.049523:0:11162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787779634.049528:0:11162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787779634.049534:0:11162:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005279aec9/0x9e63ba8af6889835 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779634.049544:0:11162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005279aec9/0x9e63ba8af6889835 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779634.049581:0:11162:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787779634.049686:0:11162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f6b5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+7:2359:x1874622505084928:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 275us (1023us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779634.049694:0:11162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 56 00010000:00010000:1.0:1787779634.049780:0:6682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005279aec9/0x9e63ba8af6889835 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779634.049798:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005279aec9/0x9e63ba8af6889835 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779634.049823:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005279aec9/0x9e63ba8af6889835 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779634.049831:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005279aec9/0x9e63ba8af6889835 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779634.049851:0:6682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005279aec9/0x9e63ba8af6889835 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779634.049858:0:6682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87a98b600 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:1.0:1787779634.049863:0:6682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005279aec9/0x9e63ba8af6889835 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779634.049872:0:6682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005279aec9/0x9e63ba8af6889835 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779634.049884:0:6682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005279aec9/0x9e63ba8af6889835 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779634.049892:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005279aec9/0x9e63ba8af6889835 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779634.049939:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ab36d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:2360:x1874622505084800:12345-192.168.201.9@tcp:1:lhsmtool_posix.0 Request processed in 4833us (4987us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779634.049948:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 46 00000100:00100000:2.0:1787779634.052598:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779634.052665:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505085184 00000100:00100000:3.0:1787779634.052673:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505085184 00000100:00100000:3.0:1787779634.052758:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 127 00000100:00100000:3.0:1787779634.052769:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e855b3cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+14:10563:x1874622505085184:12345-192.168.201.9@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787779634.052838:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af688983c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779634.052850:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af688983c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779634.052871:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af688983c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779634.053036:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af6889843 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779634.053043:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af68897f6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedadde expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779634.053048:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af6889843 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779634.053075:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af68897f6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedadde expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779634.053084:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af68897f6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedadde expref: 15 pid: 5837 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779634.053097:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ab343c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5836:1874622525022464:192.168.201.9@tcp:104: 00000100:00100000:3.0:1787779634.053168:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e84764e900 going to sleep for 11 seconds 00000100:00100000:3.0:1787779634.055879:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ab343c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5836:1874622525022464:192.168.201.9@tcp:104: 00010000:00010000:3.0:1787779634.055909:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af6889843 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779634.056998:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779634.057259:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505085312 00000100:00100000:3.0:1787779634.057267:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505085312 00010000:00010000:3.0:1787779634.057327:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af68897f6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedadde expref: 16 pid: 5837 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779634.057389:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 57 00000100:00100000:3.0:1787779634.057398:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e33c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+16:2359:x1874622505085312:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787779634.057414:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787779634.057422:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af68897f6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedadde expref: 16 pid: 5837 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779634.057434:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af68897f6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedadde expref: 16 pid: 5837 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779634.057456:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af68897f6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedadde expref: 16 pid: 5837 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779634.057473:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98e87450af00) 00010000:00010000:3.0:1787779634.057478:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af6889843 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779634.057488:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af6889843 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779634.057496:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af6889843 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779634.057919:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787779634.057981:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e33c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+15:2359:x1874622505085312:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 582us (988us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779634.057991:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 57 00010000:00010000:0.0:1787779634.061094:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af6889843 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779634.061113:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af6889843 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787779634.061455:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:0.0:1787779634.061622:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:0.0:1787779634.061970:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:0.0:1787779634.062076:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87fd283c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5836:1874622525022592:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787779634.062143:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779634.062218:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e84721d840 going to sleep for 11 seconds 00000100:00100000:1.0:1787779634.062532:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525022592 00000100:00100000:1.0:1787779634.062540:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525022592 00000100:00100000:1.0:1787779634.062741:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787779634.062750:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87fd28f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5836:x1874622525022592:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787779634.062835:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87fd28f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5836:x1874622525022592:12345-0@lo:1000:mdt00_001.0 Request processed in 87us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779634.062857:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787779634.063141:0:5836:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:0.0:1787779634.063148:0:5836:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:0.0:1787779634.063168:0:5836:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98e87a7092c0, transno 4294967309 00000100:00100000:0.0:1787779634.063182:0:5836:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff98e87a709e00 x1874622525021824/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787779649 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779634.063195:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87fd283c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5836:1874622525022592:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1787779634.063685:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:0.0:1787779634.063773:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87fd283c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5836:1874622525022720:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787779634.063821:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779634.063837:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e84721d780 going to sleep for 11 seconds 00000100:00100000:1.0:1787779634.064453:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525022720 00000100:00100000:1.0:1787779634.064461:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525022720 00000100:00100000:1.0:1787779634.064506:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787779634.064516:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87fd2a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5836:x1874622525022720:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787779634.064843:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87fd2a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5836:x1874622525022720:12345-0@lo:1000:mdt00_001.0 Request processed in 328us (1020us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1787779634.064850:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787779634.065042:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87fd283c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5836:1874622525022720:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1787779634.065084:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af6889843 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779634.065095:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af6889843 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779634.065103:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af6889843 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779634.065110:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e8429d4000 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:0.0:1787779634.065115:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af6889843 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779634.065123:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af6889843 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779634.065141:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98e87450af00) 00010000:00010000:0.0:1787779634.065145:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787779634.065151:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af6889843 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779634.065157:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af6889843 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779634.065190:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af6889786 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779634.065206:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af6889786 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779634.065211:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af6889786 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779634.065216:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e848f69800 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:0.0:1787779634.065218:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af6889786 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779634.065224:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af6889786 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779634.065231:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98e87450ad00) 00010000:00010000:0.0:1787779634.065233:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787779634.065240:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af688978d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedadc2 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779634.065251:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af688978d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedadc2 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779634.065260:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af688978d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedadc2 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779634.065398:0:5836:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af688978d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedadc2 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779634.065411:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87fd28000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5836:1874622525022848:192.168.201.9@tcp:105: 00000100:00100000:0.0:1787779634.065533:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e84721d780 going to sleep for 11 seconds 00000100:00080000:2.0:1787779634.065591:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787779634.068775:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779634.069018:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505085440 00000100:00100000:2.0:1787779634.069028:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505085440 00000100:00100000:2.0:1787779634.069086:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 31 00000100:00100000:2.0:1787779634.069096:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ab343c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+19:10562:x1874622505085440:12345-192.168.201.9@tcp:49:lfs.0 00000100:00100000:2.0:1787779634.069221:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ab343c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+19:10562:x1874622505085440:12345-192.168.201.9@tcp:49:lfs.0 Request processed in 127us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779634.069228:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 31 00000100:00100000:0.0:1787779634.070257:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87fd28000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5836:1874622525022848:192.168.201.9@tcp:105: 00010000:00010000:0.0:1787779634.070291:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af6889786 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779634.070301:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af6889786 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779634.070339:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af688984a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779634.070354:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af688984a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779634.070364:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af688984a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779634.070373:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af688984a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779634.070379:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af688984a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779634.070385:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af688984a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779634.070390:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e848f69600 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:0.0:1787779634.070393:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af688984a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779634.070399:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af688984a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779634.070425:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98e87450ad00) 00010000:00010000:0.0:1787779634.070428:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787779634.070432:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af688984a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779634.070437:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af688984a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779634.070445:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af688983c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779634.070449:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af688983c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779634.070454:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af688983c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779634.070459:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e8429d4400 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:0.0:1787779634.070461:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af688983c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779634.070466:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af688983c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779634.070472:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98e87450ad00) 00010000:00010000:0.0:1787779634.070474:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787779634.070477:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af688983c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779634.070482:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af688983c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787779634.070943:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787779634.070948:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:0.0:1787779634.071525:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e855b3cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+18:10563:x1874622505085184:12345-192.168.201.9@tcp:57:lhsmtool_posix.0 Request processed in 18754us (18929us total) trans 4294967406 rc 0/0 00000100:00100000:0.0:1787779634.071537:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 127 00000020:00080000:0.0:1787779634.071542:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1787779634.071759:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1787779634.071768:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787779634.074404:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779634.074613:0:11475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505085696 00000100:00100000:2.0:1787779634.074622:0:11475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505085696 00000100:00100000:2.0:1787779634.074687:0:11475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 32 00000100:00100000:2.0:1787779634.074697:0:11475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e86c759c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+18:10563:x1874622505085696:12345-192.168.201.9@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787779634.075447:0:11475:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787779634.075558:0:11475:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:2.0:1787779634.075602:0:11475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67200/0x9e63ba8af6889851 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779634.075620:0:11475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67200/0x9e63ba8af6889851 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 11475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779634.075632:0:11475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67200/0x9e63ba8af6889851 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 11475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779634.075640:0:11475:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67200/0x9e63ba8af6889851 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 11475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779634.075647:0:11475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67200/0x9e63ba8af6889851 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 11475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779634.075654:0:11475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67200/0x9e63ba8af6889851 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 11475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779634.075675:0:11475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787779634.075810:0:11475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e86c759c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+20:10563:x1874622505085696:12345-192.168.201.9@tcp:35:lhsmtool_posix.0 Request processed in 1113us (1413us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1787779634.075819:0:11475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 32 00000020:00080000:2.0:1787779634.075825:0:11475:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787779634.075990:0:8500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787779634.075995:0:8500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67200/0x9e63ba8af6889851 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 11475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779634.076001:0:8500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87aa67200 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:0.0:1787779634.076004:0:8500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67200/0x9e63ba8af6889851 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 11475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779634.076010:0:8500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67200/0x9e63ba8af6889851 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 11475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779634.076021:0:8500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98e84927fe00) 00010000:00010000:0.0:1787779634.076023:0:8500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787779634.076027:0:8500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67200/0x9e63ba8af6889851 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779634.076031:0:8500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67200/0x9e63ba8af6889851 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779634.076051:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779634.076052:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779634.076053:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779634.079199:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779634.079285:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505085952 00000100:00100000:1.0:1787779634.079294:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505085952 00000100:00100000:1.0:1787779634.079410:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 128 00000100:00100000:1.0:1787779634.079418:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ab343c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+20:10562:x1874622505085952:12345-192.168.201.9@tcp:58:lfs.0 00000040:00080000:1.0:1787779634.079643:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1787779634.079764:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ab343c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+20:10562:x1874622505085952:12345-192.168.201.9@tcp:58:lfs.0 Request processed in 346us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779634.079772:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 128 00000100:00100000:1.0:1787779634.106590:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779634.106690:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505086080 00000100:00100000:0.0:1787779634.106709:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505086080 00000100:00100000:0.0:1787779634.106807:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 129 00000100:00100000:0.0:1787779634.106816:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f6b4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+20:10565:x1874622505086080:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:0.0:1787779634.106856:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787779634.106877:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af6889858 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedadfa expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779634.107371:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af688985f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779634.107387:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af688985f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779634.107396:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af688985f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779634.107406:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af6889866 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779634.107410:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af6889866 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779634.107414:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af6889866 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779634.107740:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68e00/0x9e63ba8af688986d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779634.107749:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889778 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedadbb expref: 21 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779634.107755:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68e00/0x9e63ba8af688986d lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779634.107783:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889778 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedadbb expref: 21 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779634.107907:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889778 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedadbb expref: 21 pid: 5837 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779634.107932:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87fd28000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5835:1874622525022976:192.168.201.9@tcp:104: 00000100:00100000:0.0:1787779634.108088:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e84721d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787779634.114183:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779634.117318:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87fd28000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5835:1874622525022976:192.168.201.9@tcp:104: 00010000:00010000:0.0:1787779634.117348:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68e00/0x9e63ba8af688986d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779634.122585:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505086336 00000100:00100000:3.0:1787779634.122604:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505086336 00000100:00100000:3.0:1787779634.122926:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 33 00000100:00100000:3.0:1787779634.122939:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+22:5599:x1874622505086336:12345-192.168.201.9@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787779634.123234:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+23:5599:x1874622505086336:12345-192.168.201.9@tcp:35:ldlm_bl.0 Request processed in 297us (9058us total) trans 4294967409 rc 0/0 00000100:00100000:3.0:1787779634.123242:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 33 00000100:00100000:0.0:1787779634.132383:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779634.133043:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505086464 00000100:00100000:3.0:1787779634.133056:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505086464 00010000:00010000:3.0:1787779634.133111:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889778 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedadbb expref: 23 pid: 5837 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779634.133158:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 58 00000100:00100000:3.0:1787779634.133170:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87fd28000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+23:2359:x1874622505086464:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787779634.133185:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787779634.133193:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889778 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedadbb expref: 23 pid: 5837 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779634.133206:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889778 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedadbb expref: 23 pid: 5837 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779634.133228:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889778 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedadbb expref: 23 pid: 5837 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779634.133246:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98e87450ad00) 00010000:00010000:3.0:1787779634.133266:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68e00/0x9e63ba8af688986d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779634.133278:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68e00/0x9e63ba8af688986d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779634.133287:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68e00/0x9e63ba8af688986d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779634.133372:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787779634.133443:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87fd28000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+22:2359:x1874622505086464:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 275us (1070us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779634.133452:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 58 00010000:00010000:0.0:1787779634.138794:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68e00/0x9e63ba8af688986d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779634.138811:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68e00/0x9e63ba8af688986d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787779634.138941:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1787779634.138946:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787779634.138965:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68e00/0x9e63ba8af688986d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779634.138979:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68e00/0x9e63ba8af688986d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779634.139004:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af688985f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779634.139008:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af688985f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779634.139014:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af688985f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779634.139017:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e848f69800 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:1.0:1787779634.139021:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af688985f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779634.139026:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af688985f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779634.139038:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98e87450a200) 00010000:00010000:1.0:1787779634.139040:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787779634.139043:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af688985f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779634.139047:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af688985f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779634.139060:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af6889866 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779634.139064:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af6889866 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779634.139068:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af6889866 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779634.139076:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e848f68200 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:1.0:1787779634.139078:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af6889866 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779634.139082:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af6889866 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779634.139087:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98e860e78300) 00010000:00010000:1.0:1787779634.139089:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787779634.139092:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af6889866 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779634.139097:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af6889866 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779634.139138:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af6889858 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedadfa expref: 22 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779634.139153:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68e00/0x9e63ba8af688986d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedadfa expref: 21 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779634.139160:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98e87450ad00) 00010000:00010000:1.0:1787779634.139162:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787779634.139165:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e848f68e00, rc 0) 00000100:00100000:1.0:1787779634.139245:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f6b4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+21:10565:x1874622505086080:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 32429us (32668us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779634.139255:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 129 00010000:00010000:2.0:1787779634.818934:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779634.855828:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779634.855882:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779634.855907:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779634.855933:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505086848 00000100:00100000:1.0:1787779634.855941:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505086848 00000100:00100000:1.0:1787779634.855994:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 152 00000100:00100000:1.0:1787779634.856000:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f6b7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54e1e60c-3037-4ae3-b045-838eb9e0ad0b+5:2360:x1874622505086848:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:1.0:1787779634.856059:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f6b7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54e1e60c-3037-4ae3-b045-838eb9e0ad0b+5:2360:x1874622505086848:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 60us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779634.856065:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 152 00000100:00100000:1.0:1787779634.856085:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505086720 00000100:00100000:1.0:1787779634.856088:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505086720 00000100:00100000:1.0:1787779634.856113:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 83 00000100:00100000:1.0:1787779634.856120:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f6b7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+5:2360:x1874622505086720:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:1.0:1787779634.856144:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f6b7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+5:2360:x1874622505086720:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 26us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779634.856149:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 83 00000100:00080000:1.0:1787779634.856161:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787779634.856164:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787779634.857006:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505086592 00000100:00100000:2.0:1787779634.857014:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505086592 00000100:00100000:2.0:1787779634.857056:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 296 00000100:00100000:2.0:1787779634.857064:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ebf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+13:2360:x1874622505086592:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:2.0:1787779634.857128:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ebf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+13:2360:x1874622505086592:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 65us (1310us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779634.857136:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 296 00000040:00080000:3.0:1787779634.858855:0:12046:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787779634.858866:0:12046:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787779634.858913:0:12046:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1787779634.858918:0:12046:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1787779635.124587:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787779635.124597:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787779635.124646:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1787779635.124653:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787779635.127574:0:11684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f6b4f00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11684:1874622525023104:192.168.201.9@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787779635.127707:0:11684:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e848215900 going to sleep for 11 seconds 00000100:00100000:1.0:1787779635.140281:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779635.140387:0:11684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f6b4f00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11684:1874622525023104:192.168.201.9@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787779635.140581:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505086976 00000100:00100000:0.0:1787779635.140587:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505086976 00000100:00100000:0.0:1787779635.140641:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 130 00000100:00100000:0.0:1787779635.140650:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a7092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+21:10577:x1874622505086976:12345-192.168.201.9@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787779635.140802:0:5836:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787779635.140910:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a7092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+21:10577:x1874622505086976:12345-192.168.201.9@tcp:53:lhsmtool_posix.0 Request processed in 259us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779635.140918:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 130 00000100:00100000:0.0:1787779635.149979:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779635.155369:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505087232 00000100:00100000:1.0:1787779635.155384:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505087232 00000100:00100000:1.0:1787779635.155489:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 131 00000100:00100000:1.0:1787779635.155501:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e88195cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+21:10577:x1874622505087232:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787779635.155522:0:8197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779635.155543:0:8197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b800/0x9e63ba8af6889874 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedae01 expref: -99 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779635.156052:0:8197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af688987b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779635.156081:0:8197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af688987b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779635.156093:0:8197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af688987b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787779635.156105:0:8197:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787779635.156249:0:8197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b800/0x9e63ba8af6889874 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae01 expref: 24 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779635.156268:0:8197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af688987b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae01 expref: 23 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779635.156277:0:8197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98e87450ad00) 00010000:00010000:1.0:1787779635.156280:0:8197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787779635.156286:0:8197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87a98a600, rc 0) 00000100:00100000:1.0:1787779635.156366:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e88195cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+23:10577:x1874622505087232:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 Request processed in 867us (6399us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1787779635.156374:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 131 00000100:00100000:2.0:1787779635.183074:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779635.183180:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779635.183397:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505087360 00000100:00100000:1.0:1787779635.183423:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505087360 00000100:00100000:1.0:1787779635.183491:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 9 00000100:00100000:1.0:1787779635.183502:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e30f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+23:2359:x1874622505087360:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787779635.183522:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787779635.183552:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af688987b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae01 expref: 23 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779635.183571:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98e87450ad00) 00010000:00010000:1.0:1787779635.183577:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787779635.183634:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e30f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+22:2359:x1874622505087360:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 128us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779635.183642:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 9 00000100:00100000:3.0:1787779635.196336:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505087616 00000100:00100000:3.0:1787779635.196350:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505087616 00000100:00100000:3.0:1787779635.196457:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 132 00000100:00100000:3.0:1787779635.196468:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+22:10577:x1874622505087616:12345-192.168.201.9@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787779635.196552:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5400/0x9e63ba8af6889889 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779635.196571:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5400/0x9e63ba8af6889889 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779635.196583:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5400/0x9e63ba8af6889889 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779635.196827:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5400/0x9e63ba8af6889889 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779635.196835:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5400/0x9e63ba8af6889889 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779635.196842:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5400/0x9e63ba8af6889889 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779635.196849:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e8429d5400 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:3.0:1787779635.196854:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5400/0x9e63ba8af6889889 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779635.196861:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5400/0x9e63ba8af6889889 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779635.196873:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98e87450ad00) 00010000:00010000:3.0:1787779635.196876:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787779635.196881:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5400/0x9e63ba8af6889889 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779635.196887:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5400/0x9e63ba8af6889889 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779635.197045:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+23:10577:x1874622505087616:12345-192.168.201.9@tcp:57:lhsmtool_posix.0 Request processed in 578us (13863us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1787779635.197053:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 132 00000040:00080000:0.0:1787779635.202117:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787779635.202134:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787779635.202625:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1787779635.202634:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787779635.214364:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779635.214455:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505087872 00000100:00100000:3.0:1787779635.214464:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505087872 00000100:00100000:3.0:1787779635.214571:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 34 00000100:00100000:3.0:1787779635.214595:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e88195c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+23:10577:x1874622505087872:12345-192.168.201.9@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787779635.214898:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e88195c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+24:10577:x1874622505087872:12345-192.168.201.9@tcp:35:lhsmtool_posix.0 Request processed in 304us (542us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1787779635.214907:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 34 00010000:00010000:2.0:1787779635.827007:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779636.658990:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787779636.661051:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87aa32940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622525023232:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787779636.661145:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779636.667379:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525023232 00000100:00100000:2.0:1787779636.667394:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525023232 00000100:00100000:2.0:1787779636.667478:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787779636.667489:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e855b003c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1874622525023232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787779636.667531:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787779636.667635:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e855b003c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1874622525023232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 149us (6489us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779636.667643:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787779636.667729:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87aa32940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622525023232:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787779636.667929:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787779636.876495:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787779636.921579:0:12097:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787779636.921593:0:12097:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787779636.921641:0:12097:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1787779636.921648:0:12097:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787779637.187870:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779637.188024:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505088128 00000100:00100000:1.0:1787779637.188036:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505088128 00000100:00100000:1.0:1787779637.188171:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 133 00000100:00100000:1.0:1787779637.188181:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87aa32940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+24:10597:x1874622505088128:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:1.0:1787779637.188205:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779637.188225:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af6889890 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedae08 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779637.188331:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b800/0x9e63ba8af6889897 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779637.188347:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b800/0x9e63ba8af6889897 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779637.188360:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b800/0x9e63ba8af6889897 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787779637.188387:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787779637.188514:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af6889890 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae08 expref: 27 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779637.188532:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b800/0x9e63ba8af6889897 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae08 expref: 26 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779637.188541:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98e87450ad00) 00010000:00010000:1.0:1787779637.188544:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787779637.188548:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87a98b800, rc 0) 00000100:00100000:1.0:1787779637.188621:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87aa32940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+26:10597:x1874622505088128:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 441us (762us total) trans 4294967413 rc 0/0 00000100:00100000:1.0:1787779637.188629:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 133 00000100:00080000:2.0:1787779637.188864:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787779637.190956:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779637.191085:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505088256 00000100:00100000:1.0:1787779637.191095:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505088256 00000100:00100000:1.0:1787779637.191188:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 134 00000100:00100000:1.0:1787779637.191198:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e851680000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+26:10597:x1874622505088256:12345-192.168.201.9@tcp:54:lfs.0 00010000:00010000:1.0:1787779637.191261:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af68898a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779637.191280:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af68898a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779637.191292:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af68898a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779637.191320:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af68898a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779637.191342:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af68898a5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779637.191349:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af68898a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779637.191355:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87a98b600 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:1.0:1787779637.191359:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af68898a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779637.191368:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af68898a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779637.191380:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98e87450ad00) 00010000:00010000:1.0:1787779637.191383:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787779637.191388:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af68898a5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779637.191394:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af68898a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779637.191504:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e851680000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+26:10597:x1874622505088256:12345-192.168.201.9@tcp:54:lfs.0 Request processed in 307us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779637.191512:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 134 00000100:00100000:3.0:1787779637.283608:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779637.283758:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505088384 00000100:00100000:0.0:1787779637.283769:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505088384 00000100:00100000:0.0:1787779637.283857:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 47 00000100:00100000:0.0:1787779637.283868:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ab34f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:2357:x1874622505088384:12345-192.168.201.9@tcp:101:cat.0 00010000:00010000:0.0:1787779637.283886:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787779637.283908:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000041391af6/0x9e63ba8af68898ac lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedae0f expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787779637.283937:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a8f5a30, atime: 0x6a8f5a2f, ctime: 0x6a8f5a30, blocks: 0xb 00010000:00010000:0.0:1787779637.283956:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=403s v=(0 0) 00010000:00010000:0.0:1787779637.283960:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787779637.283969:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000041391af6/0x9e63ba8af68898ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae0f expref: 7 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779637.283988:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000041391af6/0x9e63ba8af68898ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae0f expref: 7 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779637.284002:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e848f68400, rc 0) 00000100:00100000:0.0:1787779637.284094:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ab34f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+7:2357:x1874622505088384:12345-192.168.201.9@tcp:101:cat.0 Request processed in 229us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779637.284101:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 47 00000100:00080000:2.0:1787779637.284556:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787779637.288092:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779637.288170:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505088512 00000100:00100000:0.0:1787779637.288180:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505088512 00002000:00100000:0.0:1787779637.288229:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff98e87aa30780 x1874622505088512/t0(0) o3->e225400f-8d32-48a8-ab5e-fe4d3780a20c@192.168.201.9@tcp:48/0 lens 488/0 e 0 to 0 dl 1787779648 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787779637.288237:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98e87aa30780 with x1874622505088512 ext(0->4095) 00002000:00010000:0.0:1787779637.288241:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98e87aa30780 00000100:00100000:0.0:1787779637.288269:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 4 00000100:00100000:0.0:1787779637.288276:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87aa30780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+7:2357:x1874622505088512:12345-192.168.201.9@tcp:3:cat.0 00000100:00100000:0.0:1787779637.288490:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87aa30780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+7:2357:x1874622505088512:12345-192.168.201.9@tcp:3:cat.0 Request processed in 213us (406us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787779637.288497:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 4 00002000:00100000:0.0:1787779637.288505:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff98e87aa30780 x1874622505088512/t0(0) o3->e225400f-8d32-48a8-ab5e-fe4d3780a20c@192.168.201.9@tcp:48/0 lens 488/4536 e 0 to 0 dl 1787779648 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787779637.288513:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98e87aa30780 with x1874622505088512 ext(0->4095) 00002000:00010000:0.0:1787779637.288517:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98e87aa30780 00000100:00100000:2.0:1787779637.702303:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ab34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874622525023488:0@lo:400:kworker.0 00000100:00100000:3.0:1787779637.702359:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ab36940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874622525023616:0@lo:400:kworker.0 00000100:00100000:2.0:1787779637.702383:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779637.702442:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779637.702452:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e881d80b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874622525024000:0@lo:400:kworker.0 00000100:00100000:3.0:1787779637.702476:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787779637.702485:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f6b4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622525023744:0@lo:400:kworker.0 00000100:00100000:2.0:1787779637.702491:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779637.702521:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779637.702521:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787779637.702530:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ab352c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c28aae66-2825-42c5-8f52-61f687e868c9:3305:1874622525023360:0@lo:400:kworker.0 00000100:00100000:2.0:1787779637.702563:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779637.702601:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e881d82940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874622525023872:0@lo:400:kworker.0 00000100:00100000:2.0:1787779637.702634:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779637.702681:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525024000 00000100:00100000:2.0:1787779637.702690:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525024000 00000100:00100000:3.0:1787779637.702705:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525023488 00000100:00100000:3.0:1787779637.702748:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525023488 00000100:00100000:2.0:1787779637.702770:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525023744 00000100:00100000:2.0:1787779637.702775:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525023744 00000100:00100000:3.0:1787779637.702783:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525023616 00000100:00100000:3.0:1787779637.702787:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525023616 00000100:00100000:3.0:1787779637.702803:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525023872 00000100:00100000:3.0:1787779637.702806:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525023872 00000100:00100000:1.0:1787779637.702813:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787779637.702822:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e848f34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874622525023488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779637.702878:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e848f34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874622525023488:12345-0@lo:400:kworker.0 Request processed in 56us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779637.702887:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787779637.702954:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e848f37840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1874622525024000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779637.702986:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e848f37840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1874622525024000:12345-0@lo:400:kworker.0 Request processed in 92us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779637.702992:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787779637.703009:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787779637.703016:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e881d81a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3306:x1874622525023744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779637.703049:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e881d81a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3306:x1874622525023744:12345-0@lo:400:kworker.0 Request processed in 34us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779637.703054:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787779637.703070:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525023360 00000100:00100000:2.0:1787779637.703073:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525023360 00000100:00100000:2.0:1787779637.703093:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:2.0:1787779637.703099:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ebe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+19:3305:x1874622525023360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779637.703126:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ebe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+19:3305:x1874622525023360:12345-0@lo:400:kworker.0 Request processed in 28us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779637.703133:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:2.0:1787779637.703170:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ab352c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c28aae66-2825-42c5-8f52-61f687e868c9:3305:1874622525023360:0@lo:400:kworker.0 00000100:00100000:2.0:1787779637.703184:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e881d80b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874622525024000:0@lo:400:kworker.0 00000100:00100000:2.0:1787779637.703193:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ab34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874622525023488:0@lo:400:kworker.0 00000100:00080000:2.0:1787779637.703233:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787779637.703237:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787779637.703253:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f6b4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622525023744:0@lo:400:kworker.0 00000100:00100000:3.0:1787779637.703315:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787779637.703323:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e881d830c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874622525023616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779637.703406:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e881d830c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874622525023616:12345-0@lo:400:kworker.0 Request processed in 84us (964us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779637.703412:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787779637.703426:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787779637.703432:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e848f35e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874622525023872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779637.703469:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e848f35e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874622525023872:12345-0@lo:400:kworker.0 Request processed in 38us (835us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779637.703475:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787779637.703512:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ab36940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874622525023616:0@lo:400:kworker.0 00000100:00100000:3.0:1787779637.703539:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e881d82940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874622525023872:0@lo:400:kworker.0 00000100:00100000:1.0:1787779637.704841:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000001:00080000:0.0:1787779637.767187:0:7634:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00010000:00010000:1.0:1787779637.880246:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779638.197834:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787779638.197870:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855b01e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622525024128:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787779638.197944:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779638.198016:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525024128 00000100:00100000:1.0:1787779638.198023:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525024128 00000100:00100000:1.0:1787779638.198070:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787779638.198079:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e855a60f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622525024128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787779638.198116:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787779638.198176:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e855a60f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622525024128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779638.198183:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787779638.198220:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1787779638.198226:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98e87aa543c0, transno 4294967304 00000100:00100000:1.0:1787779638.198243:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855b01e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622525024128:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787779638.903688:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787779639.292141:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:1.0:1787779639.292158:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:0.0:1787779639.296257:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967406 is committed 00000020:00080000:0.0:1787779639.296270:0:5857:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98e84721d840 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1787779639.296275:0:5857:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98e881dcf500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98e84721d000 00000020:00080000:0.0:1787779639.296279:0:5857:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98e881dcf400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98e845d58800 00000001:00080000:0.0:1787779639.296302:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:0.0:1787779639.296330:0:5857:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:3.0:1787779639.296647:0:5868:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:3.0:1787779639.297033:0:5868:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:0.0:1787779639.923140:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779639.968480:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779639.968520:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779639.968557:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779639.968580:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779639.968608:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779639.968652:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505089152 00000100:00100000:3.0:1787779639.968661:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505089152 00000100:00100000:3.0:1787779639.968739:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505088768 00000100:00100000:3.0:1787779639.968743:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505088768 00000100:00100000:3.0:1787779639.968767:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 156 00000100:00100000:3.0:1787779639.968775:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e881d80b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54e1e60c-3037-4ae3-b045-838eb9e0ad0b+5:2360:x1874622505089152:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:3.0:1787779639.968859:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e881d80b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54e1e60c-3037-4ae3-b045-838eb9e0ad0b+5:2360:x1874622505089152:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 84us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779639.968866:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 156 00000100:00100000:3.0:1787779639.968883:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 157 00000100:00100000:3.0:1787779639.968890:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a9612c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+13:2360:x1874622505088768:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:3.0:1787779639.968914:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a9612c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+13:2360:x1874622505088768:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 26us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779639.968934:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 157 00000100:00100000:2.0:1787779639.969123:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505088640 00000100:00100000:2.0:1787779639.969128:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505088640 00000100:00100000:2.0:1787779639.969165:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 298 00000100:00100000:2.0:1787779639.969173:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ebd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+13:2360:x1874622505088640:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:2.0:1787779639.969201:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ebd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+13:2360:x1874622505088640:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 30us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779639.969208:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 298 00000100:00100000:2.0:1787779639.969237:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505088896 00000100:00100000:2.0:1787779639.969241:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505088896 00000100:00100000:2.0:1787779639.969268:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505089024 00000100:00100000:2.0:1787779639.969271:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505089024 00000100:00100000:2.0:1787779639.969294:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 86 00000100:00100000:2.0:1787779639.969301:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e881d80f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:2360:x1874622505088896:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:2.0:1787779639.969329:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e881d80f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:2360:x1874622505088896:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 28us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779639.969335:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 86 00000100:00100000:2.0:1787779639.969348:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 87 00000100:00100000:2.0:1787779639.969354:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a963480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+5:2360:x1874622505089024:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:2.0:1787779639.969377:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a963480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+5:2360:x1874622505089024:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 23us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779639.969384:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 87 00000100:00080000:2.0:1787779639.969419:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787779639.969423:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787779639.969425:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787779640.948534:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787779641.331008:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787779641.331021:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787779641.331542:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:0.0:1787779641.331549:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787779641.779034:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787779641.779060:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e848f370c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622525024256:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787779641.779144:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779641.779482:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525024256 00000100:00100000:2.0:1787779641.779492:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525024256 00000100:00100000:2.0:1787779641.779645:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787779641.779655:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a9603c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622525024256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787779641.779696:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787779641.779771:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a9603c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622525024256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779641.779778:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787779641.779823:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:2.0:1787779641.779829:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98e87a709e00, transno 4294967310 00000004:00080000:2.0:1787779641.779840:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:2.0:1787779641.779864:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e848f370c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622525024256:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787779641.780920:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787779641.986146:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779642.806327:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87a961a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622525024768:0@lo:400:kworker.0 00000100:00100000:3.0:1787779642.806400:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779642.806457:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787779642.806462:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87a961680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874622525024640:0@lo:400:kworker.0 00000100:00100000:3.0:1787779642.806484:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779642.806512:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525024640 00000100:00100000:3.0:1787779642.806520:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525024640 00000100:00100000:3.0:1787779642.806580:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787779642.806590:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ab1a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874622525024640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779642.806634:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ab1a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874622525024640:12345-0@lo:400:kworker.0 Request processed in 46us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779642.806641:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00080000:3.0:1787779642.806661:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787779642.806692:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87a961680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874622525024640:0@lo:400:kworker.0 00000100:00100000:2.0:1787779642.806899:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87a960000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874622525024512:0@lo:400:kworker.0 00000100:00100000:2.0:1787779642.806928:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779642.806953:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ab1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874622525025024:0@lo:400:kworker.0 00000100:00100000:2.0:1787779642.806971:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779642.806988:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787779642.806992:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87a962940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c28aae66-2825-42c5-8f52-61f687e868c9:3305:1874622525024384:0@lo:400:kworker.0 00000100:00100000:2.0:1787779642.807009:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779642.807023:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ab1b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874622525024896:0@lo:400:kworker.0 00000100:00100000:2.0:1787779642.807042:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779642.807082:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525024768 00000100:00100000:2.0:1787779642.807086:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525024768 00000100:00100000:2.0:1787779642.807113:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525025024 00000100:00100000:2.0:1787779642.807129:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525025024 00000100:00100000:2.0:1787779642.807172:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787779642.807180:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ab18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622525024768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779642.807221:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ab18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622525024768:12345-0@lo:400:kworker.0 Request processed in 42us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779642.807229:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787779642.807242:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787779642.807248:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e848f36d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874622525025024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779642.807278:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e848f36d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874622525025024:12345-0@lo:400:kworker.0 Request processed in 30us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779642.807284:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787779642.807304:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525024384 00000100:00100000:2.0:1787779642.807307:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525024384 00000100:00100000:2.0:1787779642.807329:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1787779642.807335:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ebe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+19:3305:x1874622525024384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779642.807363:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ebe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+19:3305:x1874622525024384:12345-0@lo:400:kworker.0 Request processed in 29us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779642.807370:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1787779642.807393:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525024512 00000100:00100000:2.0:1787779642.807397:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525024512 00000100:00100000:2.0:1787779642.807416:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525024896 00000100:00100000:2.0:1787779642.807418:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525024896 00000100:00100000:2.0:1787779642.807436:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787779642.807441:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e848f370c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874622525024512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779642.807465:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e848f370c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874622525024512:12345-0@lo:400:kworker.0 Request processed in 25us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779642.807471:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787779642.807487:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787779642.807493:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e848f361c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874622525024896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779642.807520:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e848f361c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874622525024896:12345-0@lo:400:kworker.0 Request processed in 27us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779642.807526:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00080000:2.0:1787779642.807563:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787779642.807567:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787779642.807585:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87a962940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c28aae66-2825-42c5-8f52-61f687e868c9:3305:1874622525024384:0@lo:400:kworker.0 00000100:00100000:2.0:1787779642.807594:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ab1b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874622525024896:0@lo:400:kworker.0 00000100:00100000:2.0:1787779642.807603:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87a960000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874622525024512:0@lo:400:kworker.0 00000100:00100000:2.0:1787779642.807610:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ab1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874622525025024:0@lo:400:kworker.0 00000100:00100000:2.0:1787779642.807638:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87a961a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622525024768:0@lo:400:kworker.0 00010000:00010000:2.0:1787779643.000368:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779643.314965:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855a603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622525025152:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787779643.315037:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779643.315302:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525025152 00000100:00100000:1.0:1787779643.315311:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525025152 00000100:00100000:1.0:1787779643.315364:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787779643.315374:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ab18b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622525025152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787779643.315408:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787779643.315511:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ab18b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622525025152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 138us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779643.315518:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787779643.319457:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855a603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622525025152:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787779643.584866:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779643.585038:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505089280 00000100:00100000:2.0:1787779643.585049:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505089280 00000100:00100000:2.0:1787779643.585138:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 135 00000100:00100000:2.0:1787779643.585150:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e851680780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+13:10250:x1874622505089280:12345-192.168.201.9@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1787779643.585267:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e851680780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+13:10250:x1874622505089280:12345-192.168.201.9@tcp:60:lhsmtool_posix.0 Request processed in 120us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779643.585275:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 135 00000100:00080000:3.0:1787779643.585633:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787779643.592125:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779643.592245:0:11475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505089536 00000100:00100000:3.0:1787779643.592257:0:11475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505089536 00000100:00100000:3.0:1787779643.592323:0:11475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 35 00000100:00100000:3.0:1787779643.592332:0:11475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e848f34780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+13:10250:x1874622505089536:12345-192.168.201.9@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787779643.593804:0:11475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e848f34780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+14:10250:x1874622505089536:12345-192.168.201.9@tcp:35:lhsmtool_posix.0 Request processed in 1467us (1685us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1787779643.593817:0:11475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 35 00000100:00100000:1.0:1787779643.843087:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779643.843230:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505089664 00000100:00100000:2.0:1787779643.843241:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505089664 00000100:00100000:2.0:1787779643.843321:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 136 00000100:00100000:2.0:1787779643.843341:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e855a60780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54e1e60c-3037-4ae3-b045-838eb9e0ad0b+5:11050:x1874622505089664:12345-192.168.201.9@tcp:101:lsof.0 00010000:00010000:2.0:1787779643.843368:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779643.843398:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67200/0x9e63ba8af68898b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedae16 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779643.843463:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af68898ba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779643.843489:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af68898ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779643.843504:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af68898ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787779643.843703:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787779643.843708:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787779643.843861:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af68898ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779643.843888:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67200/0x9e63ba8af68898b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae16 expref: 7 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779643.843905:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af68898ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae16 expref: 6 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779643.843915:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e860c40100) 00010000:00010000:2.0:1787779643.843917:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787779643.843922:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87aa66e00, rc 0) 00000100:00100000:2.0:1787779643.843991:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e855a60780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54e1e60c-3037-4ae3-b045-838eb9e0ad0b+6:11050:x1874622505089664:12345-192.168.201.9@tcp:101:lsof.0 Request processed in 661us (914us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779643.843998:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 136 00000100:00080000:3.0:1787779643.844977:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787779644.019045:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787779644.416161:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:0.0:1787779644.416179:0:5857:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:3.0:1787779644.416334:0:5868:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1787779644.416344:0:5868:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:0.0:1787779645.042919:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779645.087438:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779645.087491:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779645.087534:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779645.087565:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779645.087590:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779645.087618:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505090304 00000100:00100000:0.0:1787779645.087629:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505090304 00000100:00100000:1.0:1787779645.087799:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505089920 00000100:00100000:1.0:1787779645.087803:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505089920 00000100:00100000:1.0:1787779645.087850:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 161 00000100:00100000:1.0:1787779645.087860:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec1a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+13:2359:x1874622505089920:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:1.0:1787779645.087936:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec1a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+13:2359:x1874622505089920:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 79us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779645.087944:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 161 00000100:00100000:1.0:1787779645.088066:0:10229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505090048 00000100:00100000:1.0:1787779645.088070:0:10229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505090048 00000100:00100000:1.0:1787779645.088093:0:10229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505090176 00000100:00100000:1.0:1787779645.088095:0:10229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505090176 00000100:00100000:1.0:1787779645.088112:0:10229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 90 00000100:00100000:1.0:1787779645.088118:0:10229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec18780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:2359:x1874622505090048:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:1.0:1787779645.088149:0:10229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec18780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:2359:x1874622505090048:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 31us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779645.088155:0:10229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 90 00000100:00100000:1.0:1787779645.088166:0:10229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 91 00000100:00100000:1.0:1787779645.088172:0:10229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec18b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+5:2359:x1874622505090176:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:1.0:1787779645.088192:0:10229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec18b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+5:2359:x1874622505090176:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 21us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779645.088198:0:10229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 91 00000100:00100000:0.0:1787779645.088465:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 162 00000100:00100000:0.0:1787779645.088474:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec19680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54e1e60c-3037-4ae3-b045-838eb9e0ad0b+6:2359:x1874622505090304:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:0.0:1787779645.088521:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec19680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54e1e60c-3037-4ae3-b045-838eb9e0ad0b+6:2359:x1874622505090304:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 35us (972us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779645.088527:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 162 00000100:00100000:3.0:1787779645.091329:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505089792 00000100:00100000:3.0:1787779645.091343:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505089792 00000100:00100000:3.0:1787779645.091405:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 300 00000100:00100000:3.0:1787779645.091414:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ebd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+13:2359:x1874622505089792:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:3.0:1787779645.091496:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ebd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+13:2359:x1874622505089792:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 82us (4069us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779645.091503:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 300 00000100:00080000:3.0:1787779645.091554:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787779645.091559:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787779645.091562:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787779646.066958:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779646.899061:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e848f37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622525025280:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787779646.899140:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779646.899584:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525025280 00000100:00100000:1.0:1787779646.899592:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525025280 00000100:00100000:1.0:1787779646.899667:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787779646.899677:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec1ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622525025280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787779646.899748:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787779646.899799:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec1ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622525025280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779646.899806:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:2.0:1787779646.899871:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787779646.900786:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e848f37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622525025280:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787779647.090976:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787779647.925504:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787779647.925529:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e848f37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c28aae66-2825-42c5-8f52-61f687e868c9:3305:1874622525025408:0@lo:400:kworker.0 00000100:00100000:2.0:1787779647.925612:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779647.925678:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525025408 00000100:00100000:2.0:1787779647.925685:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525025408 00000100:00100000:2.0:1787779647.925754:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1787779647.925764:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ebc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+19:3305:x1874622525025408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779647.925812:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ebc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+19:3305:x1874622525025408:12345-0@lo:400:kworker.0 Request processed in 50us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779647.925819:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1787779647.925862:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e848f37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c28aae66-2825-42c5-8f52-61f687e868c9:3305:1874622525025408:0@lo:400:kworker.0 00000100:00100000:2.0:1787779647.925901:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e848f37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874622525025536:0@lo:400:kworker.0 00000100:00100000:2.0:1787779647.925927:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779647.925955:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525025536 00000100:00100000:2.0:1787779647.925959:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525025536 00000100:00100000:2.0:1787779647.925983:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787779647.925990:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a709e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874622525025536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779647.926025:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a709e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874622525025536:12345-0@lo:400:kworker.0 Request processed in 35us (97us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779647.926030:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787779647.926057:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e848f37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874622525025536:0@lo:400:kworker.0 00000100:00100000:2.0:1787779647.926092:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e848f37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874622525025664:0@lo:400:kworker.0 00000100:00100000:2.0:1787779647.926114:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779647.926178:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787779647.926180:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787779647.926184:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f6b4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874622525025920:0@lo:400:kworker.0 00000100:00100000:1.0:1787779647.926186:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e881d82940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622525025792:0@lo:400:kworker.0 00000100:00100000:2.0:1787779647.926207:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779647.926209:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779647.926230:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525025664 00000100:00100000:1.0:1787779647.926234:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525025664 00000100:00100000:2.0:1787779647.926242:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ab34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874622525026048:0@lo:400:kworker.0 00000100:00100000:1.0:1787779647.926261:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525025920 00000100:00100000:2.0:1787779647.926264:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779647.926264:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525025920 00000100:00100000:1.0:1787779647.926283:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787779647.926290:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87fd283c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874622525025664:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787779647.926312:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787779647.926322:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87fd283c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874622525025664:12345-0@lo:400:kworker.0 Request processed in 33us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779647.926323:0:10229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525025792 00000100:00100000:2.0:1787779647.926326:0:10229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525025792 00000100:00100000:1.0:1787779647.926328:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787779647.926340:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787779647.926345:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ab36940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874622525025920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779647.926347:0:10229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525026048 00000100:00100000:2.0:1787779647.926349:0:10229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525026048 00000100:00100000:2.0:1787779647.926373:0:10229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787779647.926373:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ab36940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874622525025920:12345-0@lo:400:kworker.0 Request processed in 28us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779647.926378:0:10229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e855a63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622525025792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779647.926379:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787779647.926396:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787779647.926403:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ab352c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874622525026048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779647.926406:0:10229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e855a63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622525025792:12345-0@lo:400:kworker.0 Request processed in 29us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779647.926411:0:10229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787779647.926426:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ab352c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874622525026048:12345-0@lo:400:kworker.0 Request processed in 25us (162us total) trans 0 rc 0/0 00000100:00080000:2.0:1787779647.926427:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787779647.926442:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787779647.926479:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ab34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874622525026048:0@lo:400:kworker.0 00000100:00100000:1.0:1787779647.926481:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e881d82940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622525025792:0@lo:400:kworker.0 00000100:00100000:2.0:1787779647.926488:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f6b4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874622525025920:0@lo:400:kworker.0 00000100:00100000:1.0:1787779647.926489:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e848f37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874622525025664:0@lo:400:kworker.0 00010000:00010000:0.0:1787779648.118524:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787779648.435504:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855a603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622525026176:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787779648.435576:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779648.435742:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525026176 00000100:00100000:1.0:1787779648.435751:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525026176 00000100:00100000:0.0:1787779648.435975:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787779648.435989:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ab34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622525026176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787779648.436053:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787779648.436111:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ab34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622525026176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 127us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779648.436119:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787779648.436238:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855a603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622525026176:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787779649.142977:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787779649.350163:0:12301:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 17:27:26 (1787779646) 00010000:00010000:1.0:1787779650.163078:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779650.213282:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779650.213328:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779650.213372:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779650.213539:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505090432 00000100:00100000:2.0:1787779650.213550:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505090432 00000100:00100000:1.0:1787779650.213693:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779650.213750:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779650.213773:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505090944 00000100:00100000:1.0:1787779650.213778:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505090944 00000100:00100000:2.0:1787779650.213902:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 302 00000100:00100000:2.0:1787779650.213914:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ebf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+13:2360:x1874622505090432:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:2.0:1787779650.214002:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ebf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+13:2360:x1874622505090432:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 91us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779650.214012:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 302 00000100:00100000:1.0:1787779650.214099:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505090560 00000100:00100000:1.0:1787779650.214103:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505090560 00000100:00100000:1.0:1787779650.214128:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 166 00000100:00100000:1.0:1787779650.214135:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f6b4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54e1e60c-3037-4ae3-b045-838eb9e0ad0b+6:2360:x1874622505090944:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:1.0:1787779650.214167:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f6b4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54e1e60c-3037-4ae3-b045-838eb9e0ad0b+6:2360:x1874622505090944:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 34us (796us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779650.214174:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 166 00000100:00100000:1.0:1787779650.214188:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 167 00000100:00100000:1.0:1787779650.214194:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e848f37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+13:2360:x1874622505090560:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:1.0:1787779650.214217:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e848f37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+13:2360:x1874622505090560:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 23us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779650.214235:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 167 00000100:00100000:1.0:1787779650.214262:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505090688 00000100:00100000:1.0:1787779650.214266:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505090688 00000100:00100000:1.0:1787779650.214290:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505090816 00000100:00100000:1.0:1787779650.214293:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505090816 00000100:00100000:1.0:1787779650.214314:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 94 00000100:00100000:1.0:1787779650.214320:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e855a603c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:2360:x1874622505090688:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:1.0:1787779650.214346:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e855a603c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:2360:x1874622505090688:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 26us (1018us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779650.214352:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 94 00000100:00100000:1.0:1787779650.214612:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 95 00000100:00100000:1.0:1787779650.214623:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e881d82940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+5:2360:x1874622505090816:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:1.0:1787779650.214645:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e881d82940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+5:2360:x1874622505090816:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 26us (896us total) trans 0 rc 0/0 00000100:00080000:0.0:1787779650.218601:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787779650.218610:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787779650.218614:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787779650.220785:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 95 00010000:00010000:0.0:1787779651.189010:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787779651.571702:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787779651.571727:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787779651.572127:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:3.0:1787779651.572135:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787779651.935654:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779651.935886:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505091200 00000100:00100000:2.0:1787779651.935895:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505091200 00000100:00100000:2.0:1787779651.935950:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 137 00000100:00100000:2.0:1787779651.935958:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87aa543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+13:11315:x1874622505091200:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787779651.935978:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779651.935998:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67200/0x9e63ba8af68898c1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedae1d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779651.936079:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af68898c8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779651.936093:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af68898c8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779651.936106:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af68898c8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779651.936159:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67600/0x9e63ba8af68898cf lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779651.936167:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67600/0x9e63ba8af68898cf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779651.936173:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67600/0x9e63ba8af68898cf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779651.936995:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67a00/0x9e63ba8af68898d6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779651.937013:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67a00/0x9e63ba8af68898d6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779651.937021:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67a00/0x9e63ba8af68898d6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787779651.937032:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1787779651.937209:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af68898c8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779651.937217:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af68898c8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779651.937225:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af68898c8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779651.937230:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87aa67e00 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:2.0:1787779651.937234:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af68898c8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779651.938104:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af68898c8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779651.938120:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98e860c40200) 00010000:00010000:2.0:1787779651.938122:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787779651.938127:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af68898c8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779651.938134:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af68898c8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779651.938149:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67600/0x9e63ba8af68898cf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779651.938165:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67600/0x9e63ba8af68898cf lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779651.938172:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67600/0x9e63ba8af68898cf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779651.938176:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87aa67600 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:2.0:1787779651.938179:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67600/0x9e63ba8af68898cf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779651.938185:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67600/0x9e63ba8af68898cf lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779651.938191:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff98e84927f500) 00010000:00010000:2.0:1787779651.938193:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787779651.938196:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67600/0x9e63ba8af68898cf lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779651.938202:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67600/0x9e63ba8af68898cf lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779651.939648:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67200/0x9e63ba8af68898c1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae1d expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779651.939671:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67a00/0x9e63ba8af68898d6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae1d expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779651.939679:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98e84927fc00) 00010000:00010000:2.0:1787779651.939682:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787779651.939691:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87aa67a00, rc 0) 00000100:00100000:2.0:1787779651.939803:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87aa543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+15:11315:x1874622505091200:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 Request processed in 3844us (4156us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1787779651.939814:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 137 00000100:00100000:0.0:1787779651.952865:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779651.953177:0:11162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505091328 00000100:00100000:2.0:1787779651.953189:0:11162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505091328 00000100:00100000:2.0:1787779651.953256:0:11162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 10 00000100:00100000:2.0:1787779651.953267:0:11162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e847d95050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+15:2357:x1874622505091328:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787779651.953283:0:11162:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787779651.953309:0:11162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67a00/0x9e63ba8af68898d6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae1d expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779651.953341:0:11162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98e84927fc00) 00010000:00010000:2.0:1787779651.953348:0:11162:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787779651.953409:0:11162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e847d95050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+14:2357:x1874622505091328:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 145us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779651.953416:0:11162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 10 00000100:00100000:3.0:1787779651.976959:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779651.977128:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505091456 00000100:00100000:0.0:1787779651.977138:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505091456 00000100:00100000:0.0:1787779651.977205:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 138 00000100:00100000:0.0:1787779651.977216:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ab19680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+14:11315:x1874622505091456:12345-192.168.201.9@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1787779651.977350:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ab19680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+14:11315:x1874622505091456:12345-192.168.201.9@tcp:59:lhsmtool_posix.0 Request processed in 137us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779651.977357:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 138 00000100:00100000:2.0:1787779652.019171:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787779652.019195:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e852113480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622525026304:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787779652.019262:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779652.019333:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525026304 00000100:00100000:2.0:1787779652.019340:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525026304 00000100:00100000:2.0:1787779652.019400:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787779652.019409:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e852112940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622525026304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787779652.019440:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787779652.019478:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e852112940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622525026304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779652.019501:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1787779652.019520:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787779652.019547:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e852113480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622525026304:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787779652.215027:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787779652.595114:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787779652.595124:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787779652.595667:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787779652.595678:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787779653.043004:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e845d2ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874622525026688:0@lo:400:kworker.0 00000100:00100000:1.0:1787779653.043086:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779653.043138:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787779653.043144:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e845d2fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622525026816:0@lo:400:kworker.0 00000100:00100000:1.0:1787779653.043167:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779653.043284:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e845d2f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874622525026560:0@lo:400:kworker.0 00000100:00100000:2.0:1787779653.043312:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779653.043335:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e845d2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874622525027072:0@lo:400:kworker.0 00000100:00100000:2.0:1787779653.043356:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779653.043384:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787779653.043390:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e855b01e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c28aae66-2825-42c5-8f52-61f687e868c9:3305:1874622525026432:0@lo:400:kworker.0 00000100:00100000:2.0:1787779653.043420:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779653.043445:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e845d2cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874622525026944:0@lo:400:kworker.0 00000100:00100000:2.0:1787779653.043468:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779653.043492:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525026432 00000100:00100000:2.0:1787779653.043499:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525026432 00000100:00100000:2.0:1787779653.043537:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1787779653.043545:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ebe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+19:3305:x1874622525026432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779653.043594:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ebe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+19:3305:x1874622525026432:12345-0@lo:400:kworker.0 Request processed in 49us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779653.043601:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1787779653.043643:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e855b01e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c28aae66-2825-42c5-8f52-61f687e868c9:3305:1874622525026432:0@lo:400:kworker.0 00000100:00100000:1.0:1787779653.043700:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525026688 00000100:00100000:1.0:1787779653.043705:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525026688 00000100:00100000:1.0:1787779653.043843:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525026560 00000100:00100000:1.0:1787779653.043846:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525026560 00000100:00100000:1.0:1787779653.043861:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525026944 00000100:00100000:1.0:1787779653.043864:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525026944 00000100:00100000:0.0:1787779653.046109:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787779653.046132:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e845d2e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874622525026688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779653.046218:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e845d2e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874622525026688:12345-0@lo:400:kworker.0 Request processed in 98us (3131us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779653.046224:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787779653.046246:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1787779653.046252:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e852110f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874622525026560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779653.046286:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e852110f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874622525026560:12345-0@lo:400:kworker.0 Request processed in 35us (2973us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779653.046302:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1787779653.046323:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525026816 00000100:00100000:0.0:1787779653.046329:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525026816 00000100:00100000:0.0:1787779653.046362:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525027072 00000100:00100000:0.0:1787779653.046365:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525027072 00000100:00080000:2.0:1787779653.046840:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787779653.046846:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787779653.048269:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1787779653.048292:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e8521130c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874622525026944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779653.048384:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e8521130c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874622525026944:12345-0@lo:400:kworker.0 Request processed in 95us (4915us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779653.048391:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1787779653.048574:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787779653.048585:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f61da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622525026816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779653.048625:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f61da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622525026816:12345-0@lo:400:kworker.0 Request processed in 44us (5457us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779653.048631:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787779653.048645:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787779653.048652:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e852113480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874622525027072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779653.048681:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e852113480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874622525027072:12345-0@lo:400:kworker.0 Request processed in 30us (5324us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779653.048686:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787779653.048767:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e845d2fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622525026816:0@lo:400:kworker.0 00000100:00100000:0.0:1787779653.048781:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e845d2ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874622525026688:0@lo:400:kworker.0 00000100:00100000:0.0:1787779653.048825:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e845d2cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874622525026944:0@lo:400:kworker.0 00000100:00100000:0.0:1787779653.048836:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e845d2f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874622525026560:0@lo:400:kworker.0 00000100:00100000:0.0:1787779653.048846:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e845d2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874622525027072:0@lo:400:kworker.0 00010000:00010000:1.0:1787779653.236387:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779653.557598:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787779653.557621:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f61f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622525027200:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787779653.557688:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779653.558615:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525027200 00000100:00100000:2.0:1787779653.558626:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525027200 00000100:00100000:2.0:1787779653.558691:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787779653.558701:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f61fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622525027200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787779653.558776:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787779653.558840:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f61fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622525027200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 141us (1152us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779653.558848:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787779653.558917:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f61f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622525027200:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787779654.266489:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779654.370521:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779654.373194:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505091584 00000100:00100000:2.0:1787779654.373206:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505091584 00000100:00100000:3.0:1787779654.373508:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 139 00000100:00100000:3.0:1787779654.373520:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f61f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+14:11358:x1874622505091584:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:3.0:1787779654.373541:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779654.373564:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5800/0x9e63ba8af68898e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedae24 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.373629:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5400/0x9e63ba8af68898eb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.373645:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5400/0x9e63ba8af68898eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.373657:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5400/0x9e63ba8af68898eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.373673:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5200/0x9e63ba8af68898f2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.373680:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5200/0x9e63ba8af68898f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.373687:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5200/0x9e63ba8af68898f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.374090:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5400/0x9e63ba8af68898eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.374098:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5400/0x9e63ba8af68898eb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.374103:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5400/0x9e63ba8af68898eb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.374117:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e8429d5400 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:3.0:1787779654.374121:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5400/0x9e63ba8af68898eb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.374128:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5400/0x9e63ba8af68898eb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.374140:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e860c40100) 00010000:00010000:3.0:1787779654.374143:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779654.374148:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5400/0x9e63ba8af68898eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.374154:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5400/0x9e63ba8af68898eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.374165:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5200/0x9e63ba8af68898f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.374171:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5200/0x9e63ba8af68898f2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.374176:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5200/0x9e63ba8af68898f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.374181:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e8429d5200 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:3.0:1787779654.374183:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5200/0x9e63ba8af68898f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.374189:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5200/0x9e63ba8af68898f2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.374206:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff98e87450a400) 00010000:00010000:3.0:1787779654.374209:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779654.374212:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5200/0x9e63ba8af68898f2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.374218:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5200/0x9e63ba8af68898f2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.374248:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5800/0x9e63ba8af68898e4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae24 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.374259:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e860c40100) 00010000:00010000:3.0:1787779654.374261:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779654.374265:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5800/0x9e63ba8af68898e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae24 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.374273:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e8429d5800, rc 0) 00000100:00100000:3.0:1787779654.374342:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f61f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+14:11358:x1874622505091584:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 824us (3828us total) trans 0 rc 301/301 00000100:00100000:3.0:1787779654.374361:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 139 00000100:00080000:2.0:1787779654.376160:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787779654.385240:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779654.385387:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505091840 00000100:00100000:0.0:1787779654.385397:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505091840 00000100:00100000:0.0:1787779654.385465:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 140 00000100:00100000:0.0:1787779654.385476:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ab1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+14:11358:x1874622505091840:12345-192.168.201.9@tcp:36:lfs.0 00010000:00010000:0.0:1787779654.385545:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787779654.385572:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98be00/0x9e63ba8af6889262 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac5d expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779654.385591:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e860c40100) 00010000:00010000:0.0:1787779654.385596:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787779654.385881:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68800/0x9e63ba8af68898f9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779654.385895:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af68898ba lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae16 expref: 5 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779654.385904:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68800/0x9e63ba8af68898f9 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779654.385933:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af68898ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae16 expref: 5 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779654.385946:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af68898ba lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae16 expref: 5 pid: 5836 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779654.385959:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ec18f00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5837:1874622525027328:192.168.201.9@tcp:104: 00000100:00100000:0.0:1787779654.386056:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e848e736c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787779654.388240:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ec18f00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5837:1874622525027328:192.168.201.9@tcp:104: 00010000:00010000:3.0:1787779654.388267:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68800/0x9e63ba8af68898f9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779654.389865:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779654.390086:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505091968 00000100:00100000:2.0:1787779654.390095:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505091968 00010000:00010000:2.0:1787779654.390147:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af68898ba lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae16 expref: 6 pid: 5836 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779654.390179:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 59 00000100:00100000:2.0:1787779654.390186:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ab1b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:54e1e60c-3037-4ae3-b045-838eb9e0ad0b+6:2360:x1874622505091968:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787779654.390199:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787779654.390205:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af68898ba lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae16 expref: 6 pid: 5836 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779654.390215:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af68898ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae16 expref: 6 pid: 5836 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779654.390235:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af68898ba lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae16 expref: 6 pid: 5836 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779654.390264:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e860c40100) 00010000:00010000:2.0:1787779654.390270:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68800/0x9e63ba8af68898f9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779654.390278:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68800/0x9e63ba8af68898f9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779654.390285:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68800/0x9e63ba8af68898f9 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779654.390318:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787779654.390376:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ab1b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:54e1e60c-3037-4ae3-b045-838eb9e0ad0b+5:2360:x1874622505091968:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 190us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779654.390382:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 59 00010000:00010000:2.0:1787779654.390470:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68800/0x9e63ba8af68898f9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779654.390477:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68800/0x9e63ba8af68898f9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779654.390495:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66400/0x9e63ba8af6889900 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779654.390504:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66400/0x9e63ba8af6889900 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779654.390510:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66400/0x9e63ba8af6889900 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787779654.391468:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1787779654.391484:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68800/0x9e63ba8af68898f9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779654.391491:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68800/0x9e63ba8af68898f9 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779654.391496:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68800/0x9e63ba8af68898f9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779654.391502:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e848f68800 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:2.0:1787779654.391505:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68800/0x9e63ba8af68898f9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779654.391511:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68800/0x9e63ba8af68898f9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779654.391520:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e860c40100) 00010000:00010000:2.0:1787779654.391523:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787779654.391527:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68800/0x9e63ba8af68898f9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779654.391532:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68800/0x9e63ba8af68898f9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787779654.391547:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000054317f98 reply state 00000000de5e2424 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66400/0x9e63ba8af6889900 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779654.391555:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787779654.391621:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ab1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+15:11358:x1874622505091840:12345-192.168.201.9@tcp:36:lfs.0 Request processed in 6147us (6392us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1787779654.391628:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 140 00000100:00080000:3.0:1787779654.392934:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787779654.393486:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66400/0x9e63ba8af6889900 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.393499:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66400/0x9e63ba8af6889900 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.393506:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66400/0x9e63ba8af6889900 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.393511:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87aa66400 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:3.0:1787779654.393516:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66400/0x9e63ba8af6889900 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.393523:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66400/0x9e63ba8af6889900 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.393536:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff98e84927f900) 00010000:00010000:3.0:1787779654.393539:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779654.393543:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66400/0x9e63ba8af6889900 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.393549:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66400/0x9e63ba8af6889900 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779654.501989:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779654.502028:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505092096 00000100:00100000:3.0:1787779654.502037:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505092096 00000100:00100000:3.0:1787779654.502093:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 141 00000100:00100000:3.0:1787779654.502103:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a962d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+14:11366:x1874622505092096:12345-192.168.201.9@tcp:101:lctl.0 00010000:00010000:3.0:1787779654.502127:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779654.502149:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5800/0x9e63ba8af6889907 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedae2b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.502214:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5200/0x9e63ba8af688990e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.502226:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5200/0x9e63ba8af688990e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.502236:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5200/0x9e63ba8af688990e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787779654.502291:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787779654.502295:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1787779654.502445:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5200/0x9e63ba8af688990e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.502470:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5800/0x9e63ba8af6889907 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae2b expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.502486:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5200/0x9e63ba8af688990e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae2b expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.502494:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e87450a400) 00010000:00010000:3.0:1787779654.502497:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787779654.502500:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e8429d5200, rc 0) 00000100:00100000:3.0:1787779654.502550:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a962d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+15:11366:x1874622505092096:12345-192.168.201.9@tcp:101:lctl.0 Request processed in 451us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779654.502557:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 141 00000100:00100000:2.0:1787779654.600218:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779654.600308:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505092224 00000100:00100000:3.0:1787779654.600319:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505092224 00000100:00100000:3.0:1787779654.600396:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 142 00000100:00100000:3.0:1787779654.600406:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e855b01e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+15:11372:x1874622505092224:12345-192.168.201.9@tcp:101:bash.0 00010000:00010000:3.0:1787779654.600426:0:8197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779654.600448:0:8197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5800/0x9e63ba8af6889915 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedae32 expref: -99 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.600511:0:8197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5400/0x9e63ba8af688991c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.600527:0:8197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5400/0x9e63ba8af688991c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.600538:0:8197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5400/0x9e63ba8af688991c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.600552:0:8197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af6889923 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.600558:0:8197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af6889923 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.600564:0:8197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af6889923 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.600692:0:8197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af688992a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.600702:0:8197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af688992a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.600909:0:8197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af688992a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787779654.600953:0:8197:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:3.0:1787779654.600957:0:8197:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787779654.600987:0:8197:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af688992a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.600999:0:8197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5400/0x9e63ba8af688991c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.601006:0:8197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5400/0x9e63ba8af688991c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.601013:0:8197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5400/0x9e63ba8af688991c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.601018:0:8197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e8429d5400 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:3.0:1787779654.601022:0:8197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5400/0x9e63ba8af688991c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.601029:0:8197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5400/0x9e63ba8af688991c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.601041:0:8197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e87450a400) 00010000:00010000:3.0:1787779654.601044:0:8197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779654.601049:0:8197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5400/0x9e63ba8af688991c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.601055:0:8197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5400/0x9e63ba8af688991c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.601070:0:8197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af6889923 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.601086:0:8197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af6889923 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.601093:0:8197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af6889923 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.601098:0:8197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e8429d4400 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:3.0:1787779654.601101:0:8197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af6889923 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.601107:0:8197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af6889923 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.601115:0:8197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff98e87450aa00) 00010000:00010000:3.0:1787779654.601117:0:8197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779654.601120:0:8197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af6889923 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.601126:0:8197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af6889923 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.601165:0:8197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5800/0x9e63ba8af6889915 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae32 expref: 17 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.601179:0:8197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af688992a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae32 expref: 16 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.601186:0:8197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98e87450a100) 00010000:00010000:3.0:1787779654.601189:0:8197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787779654.601196:0:8197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e8429d4000, rc 0) 00000100:00100000:3.0:1787779654.601269:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e855b01e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+16:11372:x1874622505092224:12345-192.168.201.9@tcp:101:bash.0 Request processed in 863us (1060us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779654.601278:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 142 00000100:00100000:2.0:1787779654.605159:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779654.605221:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505092480 00000100:00100000:3.0:1787779654.605230:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505092480 00000100:00100000:3.0:1787779654.605291:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 143 00000100:00100000:3.0:1787779654.605300:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f6b6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+16:11372:x1874622505092480:12345-192.168.201.9@tcp:101:bash.0 00010000:00010000:3.0:1787779654.605319:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779654.605338:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af6889931 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedae39 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.605476:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af6889938 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.605489:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af6889938 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.605499:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af6889938 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.605549:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e882049a00/0x9e63ba8af688993f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.605556:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e882049a00/0x9e63ba8af688993f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.605561:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e882049a00/0x9e63ba8af688993f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787779654.606203:0:5835:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:3.0:1787779654.606422:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e882049c00/0x9e63ba8af6889946 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.606434:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e882049c00/0x9e63ba8af6889946 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.606443:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e882049c00/0x9e63ba8af6889946 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.606478:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af6889938 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.606485:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af6889938 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.606492:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af6889938 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.606498:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e8429d5c00 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:3.0:1787779654.606502:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af6889938 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.606510:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af6889938 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.606522:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98e87450a100) 00010000:00010000:3.0:1787779654.606525:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779654.606529:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af6889938 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.606534:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af6889938 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787779654.606560:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e4175f8e reply state 0000000061bebfc2 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff98e882049a00/0x9e63ba8af688993f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779654.606569:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787779654.606601:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af6889931 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae39 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.606615:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e882049c00/0x9e63ba8af6889946 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae39 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.606621:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e87450a800) 00010000:00010000:3.0:1787779654.606623:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787779654.606626:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e882049c00, rc 0) 00000100:00100000:3.0:1787779654.606696:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f6b6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+19:11372:x1874622505092480:12345-192.168.201.9@tcp:101:bash.0 Request processed in 1396us (1544us total) trans 4294967417 rc 0/0 00000100:00100000:3.0:1787779654.606704:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 143 00000100:00100000:3.0:1787779654.616675:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00010000:00010000:3.0:1787779654.617080:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98e882049a00/0x9e63ba8af688993f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.617094:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e882049a00/0x9e63ba8af688993f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.617102:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e882049a00/0x9e63ba8af688993f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.617108:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e882049a00 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:3.0:1787779654.617113:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e882049a00/0x9e63ba8af688993f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.617132:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e882049a00/0x9e63ba8af688993f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.617150:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98e87450a900) 00010000:00010000:3.0:1787779654.617153:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779654.617158:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e882049a00/0x9e63ba8af688993f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.617165:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e882049a00/0x9e63ba8af688993f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779654.617205:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505092608 00000100:00100000:3.0:1787779654.617214:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505092608 00000100:00100000:3.0:1787779654.617270:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 48 00000100:00100000:3.0:1787779654.617280:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a961a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+5:2360:x1874622505092608:12345-192.168.201.9@tcp:101:bash.0 00010000:00010000:3.0:1787779654.617310:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779654.617331:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d5b7a3da/0x9e63ba8af6889954 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedae40 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787779654.617367:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787779654.617387:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=420s v=(0 0) 00010000:00010000:3.0:1787779654.617392:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787779654.617402:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5b7a3da/0x9e63ba8af6889954 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae40 expref: 6 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.617419:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d5b7a3da/0x9e63ba8af6889954 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae40 expref: 6 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.617443:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e840030400, rc 0) 00000100:00100000:3.0:1787779654.617495:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a961a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:2360:x1874622505092608:12345-192.168.201.9@tcp:101:bash.0 Request processed in 216us (827us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779654.617501:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 48 00000100:00080000:3.0:1787779654.617521:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787779654.623387:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779654.623432:0:10229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505092736 00000100:00100000:2.0:1787779654.623441:0:10229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505092736 00000100:00100000:2.0:1787779654.623501:0:10229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 49 00000100:00100000:2.0:1787779654.623510:0:10229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f6b5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:11372:x1874622505092736:12345-192.168.201.9@tcp:101:bash.0 00010000:00010000:2.0:1787779654.623528:0:10229:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779654.623545:0:10229:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b04a2627/0x9e63ba8af688995b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedae47 expref: -99 pid: 10229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779654.623574:0:10229:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d5b7a3da/0x9e63ba8af6889954 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae40 expref: 7 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779654.623583:0:10229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787779654.623587:0:10229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787779654.623593:0:10229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b04a2627/0x9e63ba8af688995b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae47 expref: 7 pid: 10229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779654.623625:0:10229:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d5b7a3da/0x9e63ba8af6889954 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae40 expref: 7 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779654.623639:0:10229:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d5b7a3da/0x9e63ba8af6889954 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae40 expref: 7 pid: 6681 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779654.623652:0:10229:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87fd28000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10229:1874622525027456:192.168.201.9@tcp:104: 00000100:00100000:2.0:1787779654.625256:0:10229:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e84721d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787779654.630155:0:10229:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87fd28000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10229:1874622525027456:192.168.201.9@tcp:104: 00000100:00100000:0.0:1787779654.630170:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00010000:00010000:1.0:1787779654.630191:0:10229:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b04a2627/0x9e63ba8af688995b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae47 expref: 7 pid: 10229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779654.630213:0:10229:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87aa67e00, rc 0) 00000100:00100000:1.0:1787779654.630271:0:10229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f6b5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+7:11372:x1874622505092736:12345-192.168.201.9@tcp:101:bash.0 Request processed in 6761us (7560us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779654.630280:0:10229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 49 00000100:00100000:2.0:1787779654.631406:0:11162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505092864 00000100:00100000:2.0:1787779654.631415:0:11162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505092864 00010000:00010000:2.0:1787779654.631458:0:11162:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d5b7a3da/0x9e63ba8af6889954 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae40 expref: 7 pid: 6681 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779654.631501:0:11162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 60 00000100:00100000:2.0:1787779654.631510:0:11162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec18f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+7:2360:x1874622505092864:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787779654.631525:0:11162:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787779654.631546:0:11162:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d5b7a3da/0x9e63ba8af6889954 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae40 expref: 7 pid: 6681 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779654.631558:0:11162:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d5b7a3da/0x9e63ba8af6889954 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae40 expref: 7 pid: 6681 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779654.631582:0:11162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5b7a3da/0x9e63ba8af6889954 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae40 expref: 7 pid: 6681 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779654.631597:0:11162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787779654.631601:0:11162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787779654.631611:0:11162:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b04a2627/0x9e63ba8af688995b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae47 expref: 6 pid: 10229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779654.631620:0:11162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b04a2627/0x9e63ba8af688995b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae47 expref: 6 pid: 10229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779654.631658:0:11162:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b04a2627/0x9e63ba8af688995b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae47 expref: 6 pid: 10229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779654.631688:0:11162:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87fd28000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11162:1874622525027584:192.168.201.9@tcp:105: 00000100:00100000:2.0:1787779654.632424:0:11162:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e84721d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787779654.638022:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779654.638509:0:11162:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87fd28000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11162:1874622525027584:192.168.201.9@tcp:105: 00010000:00010000:3.0:1787779654.638534:0:11162:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787779654.638595:0:11162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec18f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:2360:x1874622505092864:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 7086us (8424us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779654.638607:0:11162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 60 00000100:00100000:3.0:1787779654.639504:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505093120 00000100:00100000:3.0:1787779654.639512:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505093120 00000100:00100000:3.0:1787779654.639561:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 36 00000100:00100000:3.0:1787779654.639569:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec192c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+18:11372:x1874622505093120:12345-192.168.201.9@tcp:35:bash.0 00000001:00080000:3.0:1787779654.639886:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967418 00000100:00100000:3.0:1787779654.643148:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec192c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+20:11372:x1874622505093120:12345-192.168.201.9@tcp:35:bash.0 Request processed in 3568us (5127us total) trans 4294967419 rc 0/0 00000100:00100000:3.0:1787779654.643162:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 36 00000020:00080000:3.0:1787779654.643170:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000001:00080000:3.0:1787779654.686128:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000100:00100000:0.0:1787779654.724831:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779654.725080:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505093376 00000100:00100000:2.0:1787779654.725098:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505093376 00000100:00100000:2.0:1787779654.725179:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 144 00000100:00100000:2.0:1787779654.725192:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e845d2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+18:11382:x1874622505093376:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:2.0:1787779654.725229:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779654.725260:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67600/0x9e63ba8af6889962 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedae4e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787779654.725445:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:2.0:1787779654.725551:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67600/0x9e63ba8af6889962 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae4e expref: 20 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779654.725566:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e87450a400) 00010000:00010000:2.0:1787779654.725569:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787779654.725575:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67600/0x9e63ba8af6889962 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae4e expref: 20 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779654.725588:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87aa67600, rc 0) 00000100:00100000:2.0:1787779654.725649:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e845d2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+19:11382:x1874622505093376:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 460us (828us total) trans 4294967420 rc 301/301 00000100:00100000:2.0:1787779654.725657:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 144 00000100:00100000:3.0:1787779654.730639:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779654.730931:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505093632 00000100:00100000:0.0:1787779654.730940:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505093632 00000100:00100000:0.0:1787779654.731021:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 37 00000100:00100000:0.0:1787779654.731031:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a960000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+19:11382:x1874622505093632:12345-192.168.201.9@tcp:35:lfs.0 00000100:00100000:0.0:1787779654.731298:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a960000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+20:11382:x1874622505093632:12345-192.168.201.9@tcp:35:lfs.0 Request processed in 268us (680us total) trans 4294967421 rc 0/0 00000100:00100000:0.0:1787779654.731305:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 37 00000100:00100000:0.0:1787779654.795023:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779654.795118:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505093760 00000100:00100000:3.0:1787779654.795128:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505093760 00000100:00100000:3.0:1787779654.795189:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 145 00000100:00100000:3.0:1787779654.795200:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e845d2f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+20:11388:x1874622505093760:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:3.0:1787779654.795237:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779654.795256:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031a00/0x9e63ba8af6889970 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedae55 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.795328:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030000/0x9e63ba8af6889977 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.795349:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030000/0x9e63ba8af6889977 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.795361:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030000/0x9e63ba8af6889977 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787779654.795418:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1787779654.795422:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787779654.795441:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030000/0x9e63ba8af6889977 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.795464:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031a00/0x9e63ba8af6889970 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae55 expref: 22 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.795482:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030000/0x9e63ba8af6889977 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae55 expref: 21 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.795489:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98e87450a100) 00010000:00010000:3.0:1787779654.795491:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787779654.795494:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e840030000, rc 0) 00000100:00100000:3.0:1787779654.795557:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e845d2f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+21:11388:x1874622505093760:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 360us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779654.795563:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 145 00000100:00100000:3.0:1787779654.801839:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779654.802011:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505094016 00000100:00100000:2.0:1787779654.802020:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505094016 00000100:00100000:2.0:1787779654.802086:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 146 00000100:00100000:2.0:1787779654.802094:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a962940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+21:11388:x1874622505094016:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:2.0:1787779654.802114:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779654.802132:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67600/0x9e63ba8af688997e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedae5c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779654.802223:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67200/0x9e63ba8af6889985 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779654.802236:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67200/0x9e63ba8af6889985 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779654.802247:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67200/0x9e63ba8af6889985 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787779654.802256:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787779654.802406:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67600/0x9e63ba8af688997e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae5c expref: 24 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779654.802424:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67200/0x9e63ba8af6889985 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae5c expref: 23 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779654.802434:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e87450a800) 00010000:00010000:2.0:1787779654.802436:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787779654.802440:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87aa67200, rc 0) 00000100:00100000:2.0:1787779654.802502:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a962940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+23:11388:x1874622505094016:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 407us (672us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1787779654.802511:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 146 00000100:00100000:0.0:1787779654.806662:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779654.806913:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505094272 00000100:00100000:3.0:1787779654.806922:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505094272 00000100:00100000:3.0:1787779654.806982:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 147 00000100:00100000:3.0:1787779654.806990:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e845d2cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+23:11388:x1874622505094272:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:3.0:1787779654.807013:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779654.807031:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031a00/0x9e63ba8af6889993 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedae63 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.807129:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031800/0x9e63ba8af688999a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.807144:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031800/0x9e63ba8af688999a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.807155:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031800/0x9e63ba8af688999a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787779654.807166:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787779654.807296:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031a00/0x9e63ba8af6889993 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae63 expref: 26 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.807315:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031800/0x9e63ba8af688999a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae63 expref: 25 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.807323:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e87450a800) 00010000:00010000:3.0:1787779654.807327:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787779654.807330:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e840031800, rc 0) 00000100:00100000:3.0:1787779654.807405:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e845d2cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+25:11388:x1874622505094272:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 415us (753us total) trans 4294967423 rc 0/0 00000100:00100000:3.0:1787779654.807430:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 147 00000100:00100000:0.0:1787779654.814546:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779654.814593:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779654.814678:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505094528 00000100:00100000:1.0:1787779654.814688:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505094528 00000100:00100000:1.0:1787779654.814774:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 11 00000100:00100000:1.0:1787779654.814798:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e845d2fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+25:2357:x1874622505094528:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787779654.814812:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787779654.814836:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67200/0x9e63ba8af6889985 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae5c expref: 25 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779654.814853:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e87450a800) 00010000:00010000:1.0:1787779654.814868:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787779654.814915:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e845d2fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+24:2357:x1874622505094528:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 133us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779654.814922:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 11 00000100:00100000:3.0:1787779654.816017:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505094400 00000100:00100000:3.0:1787779654.816026:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505094400 00000100:00100000:3.0:1787779654.816078:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 50 00000100:00100000:3.0:1787779654.816087:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e845d2ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:2358:x1874622505094400:12345-192.168.201.9@tcp:1:lfs.0 00010000:00010000:3.0:1787779654.816126:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b5ce470/0x9e63ba8af68899a8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.816147:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b04a2627/0x9e63ba8af688995b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae47 expref: 6 pid: 10229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.816156:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787779654.816159:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787779654.816164:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b5ce470/0x9e63ba8af68899a8 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.816198:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b04a2627/0x9e63ba8af688995b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae47 expref: 6 pid: 10229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.816212:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b04a2627/0x9e63ba8af688995b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae47 expref: 6 pid: 10229 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779654.816226:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87a961680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1874622525027712:192.168.201.9@tcp:104: 00000100:00100000:3.0:1787779654.816422:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e8493aff00 going to sleep for 11 seconds 00000100:00100000:0.0:1787779654.819692:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779654.819955:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505094656 00000100:00100000:1.0:1787779654.819972:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505094656 00002000:00100000:1.0:1787779654.820016:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff98e87f53bc00 x1874622505094656/t0(0) o4->e225400f-8d32-48a8-ab5e-fe4d3780a20c@192.168.201.9@tcp:65/0 lens 504/0 e 0 to 0 dl 1787779665 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787779654.820027:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98e87f53bc00 with x1874622505094656 ext(0->12) 00010000:00010000:1.0:1787779654.820035:0:6685:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b04a2627/0x9e63ba8af688995b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae47 expref: 7 pid: 10229 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779654.820051:0:6685:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b04a2627/0x9e63ba8af688995b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae47 expref: 7 pid: 10229 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787779654.820059:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff98e87f53bc00 00000100:00100000:1.0:1787779654.820087:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 1 00000100:00100000:1.0:1787779654.820096:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f53bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+7:2359:x1874622505094656:12345-192.168.201.9@tcp:4:lfs.0 00000100:00100000:1.0:1787779654.820931:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f53bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+9:2359:x1874622505094656:12345-192.168.201.9@tcp:4:lfs.0 Request processed in 831us (1246us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1787779654.820942:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 1 00002000:00100000:1.0:1787779654.820950:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff98e87f53bc00 x1874622505094656/t4294967305(0) o4->e225400f-8d32-48a8-ab5e-fe4d3780a20c@192.168.201.9@tcp:65/0 lens 504/448 e 0 to 0 dl 1787779665 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787779654.820959:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98e87f53bc00 with x1874622505094656 ext(0->12) 00010000:00010000:1.0:1787779654.820965:0:6685:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b04a2627/0x9e63ba8af688995b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae47 expref: 9 pid: 10229 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779654.820986:0:6685:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b04a2627/0x9e63ba8af688995b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae47 expref: 9 pid: 10229 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787779654.820993:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff98e87f53bc00 00000100:00100000:3.0:1787779654.821123:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87a961680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1874622525027712:192.168.201.9@tcp:104: 00010000:00010000:3.0:1787779654.821153:0:6681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009b5ce470/0x9e63ba8af68899a8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779654.823832:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779654.823907:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505094784 00000100:00100000:3.0:1787779654.823916:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505094784 00010000:00010000:3.0:1787779654.823953:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b04a2627/0x9e63ba8af688995b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae47 expref: 9 pid: 10229 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779654.824085:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 61 00000100:00100000:3.0:1787779654.824095:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87aa54780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+9:2357:x1874622505094784:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787779654.824111:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787779654.824129:0:5821:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1787779654.824132:0:5821:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787779654 00002000:00010000:3.0:1787779654.824135:0:5821:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787779654 00002000:00010000:3.0:1787779654.824136:0:5821:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1787779654 00010000:00010000:3.0:1787779654.824143:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b04a2627/0x9e63ba8af688995b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae47 expref: 9 pid: 10229 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.824157:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b04a2627/0x9e63ba8af688995b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae47 expref: 9 pid: 10229 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.824179:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b04a2627/0x9e63ba8af688995b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae47 expref: 9 pid: 10229 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.824195:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787779654.824200:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787779654.824217:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009b5ce470/0x9e63ba8af68899a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.824227:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b5ce470/0x9e63ba8af68899a8 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.824263:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787779654.824326:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87aa54780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+8:2357:x1874622505094784:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 231us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779654.824334:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 61 00010000:00010000:0.0:1787779654.824399:0:6681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009b5ce470/0x9e63ba8af68899a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779654.824409:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b5ce470/0x9e63ba8af68899a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779654.824433:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b5ce470/0x9e63ba8af68899a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779654.824443:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009b5ce470/0x9e63ba8af68899a8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779654.824451:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009b5ce470/0x9e63ba8af68899a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779654.824458:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e840030200 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:0.0:1787779654.824469:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009b5ce470/0x9e63ba8af68899a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779654.824479:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009b5ce470/0x9e63ba8af68899a8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779654.824491:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009b5ce470/0x9e63ba8af68899a8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779654.824499:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b5ce470/0x9e63ba8af68899a8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779654.824550:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e845d2ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+7:2358:x1874622505094400:12345-192.168.201.9@tcp:1:lfs.0 Request processed in 8464us (10015us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779654.824558:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 50 00000100:00100000:2.0:1787779654.831211:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779654.831364:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505095040 00000100:00100000:3.0:1787779654.831375:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505095040 00000100:00100000:3.0:1787779654.831439:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 38 00000100:00100000:3.0:1787779654.831449:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e86c758450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+24:11388:x1874622505095040:12345-192.168.201.9@tcp:35:lfs.0 00000004:00010000:3.0:1787779654.831516:0:5839:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031800/0x9e63ba8af688999a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae63 expref: 24 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787779654.832046:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:3.0:1787779654.832091:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:3.0:1787779654.833052:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00010000:00010000:3.0:1787779654.833108:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031a00/0x9e63ba8af68899af lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.833125:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e882049c00/0x9e63ba8af6889946 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae39 expref: 28 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.833132:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031a00/0x9e63ba8af68899af lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.833409:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98e882049c00/0x9e63ba8af6889946 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae39 expref: 28 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.833425:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98e882049c00/0x9e63ba8af6889946 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae39 expref: 28 pid: 5835 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779654.833438:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87a961680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5839:1874622525027840:192.168.201.9@tcp:104: 00000100:00100000:3.0:1787779654.833569:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e85191ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1787779654.837013:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779654.837083:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505095168 00000100:00100000:2.0:1787779654.837091:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505095168 00010000:00010000:2.0:1787779654.837127:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e882049c00/0x9e63ba8af6889946 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae39 expref: 29 pid: 5835 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779654.837165:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 62 00000100:00100000:2.0:1787779654.837175:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e881dda1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+29:2360:x1874622505095168:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787779654.837190:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787779654.837197:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98e882049c00/0x9e63ba8af6889946 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae39 expref: 29 pid: 5835 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779654.837209:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98e882049c00/0x9e63ba8af6889946 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae39 expref: 29 pid: 5835 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779654.837230:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e87450a800) 00010000:00010000:2.0:1787779654.837235:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031a00/0x9e63ba8af68899af lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779654.837244:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031a00/0x9e63ba8af68899af lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779654.837251:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031a00/0x9e63ba8af68899af lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779654.837270:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787779654.837348:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e881dda1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+29:2360:x1874622505095168:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 166us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779654.837356:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 62 00010000:00010000:3.0:1787779654.838888:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e882049c00/0x9e63ba8af6889946 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae39 expref: 28 pid: 5835 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779654.838908:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87a961680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5839:1874622525027840:192.168.201.9@tcp:104: 00010000:00010000:3.0:1787779654.838928:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031a00/0x9e63ba8af68899af lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.838936:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031a00/0x9e63ba8af68899af lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.838940:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031a00/0x9e63ba8af68899af lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787779654.839115:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000001:00080000:3.0:1787779654.839377:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:3.0:1787779654.839490:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87a961680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5839:1874622525027968:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787779654.839552:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779654.839650:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e85191a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787779654.840150:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525027968 00000100:00100000:1.0:1787779654.840157:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525027968 00000100:00100000:1.0:1787779654.840236:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787779654.840244:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e848fd6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5839:x1874622525027968:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787779654.840390:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e848fd6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5839:x1874622525027968:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 147us (837us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779654.840397:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787779654.840456:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87a961680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5839:1874622525027968:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787779654.840894:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:2.0:1787779654.840948:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87fd28000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5839:1874622525028096:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787779654.840993:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779654.841442:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e844dc79c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787779654.841489:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525028096 00000100:00100000:3.0:1787779654.841500:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525028096 00000100:00100000:3.0:1787779654.841526:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787779654.841532:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a961680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5839:x1874622525028096:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787779654.841697:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a961680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5839:x1874622525028096:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 164us (702us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1787779654.841703:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787779654.841842:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87fd28000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5839:1874622525028096:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787779654.841886:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:2.0:1787779654.841919:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031a00/0x9e63ba8af68899af lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779654.841927:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031a00/0x9e63ba8af68899af lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779654.841934:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031a00/0x9e63ba8af68899af lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779654.841940:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e840031a00 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:2.0:1787779654.841944:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031a00/0x9e63ba8af68899af lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779654.841950:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031a00/0x9e63ba8af68899af lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779654.841973:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e87450a800) 00010000:00010000:2.0:1787779654.841976:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787779654.841980:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031a00/0x9e63ba8af68899af lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779654.841985:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031a00/0x9e63ba8af68899af lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787779654.842142:0:5839:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787779654.842249:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:2.0:1787779654.842259:0:5839:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 420583547027ns, next at 421583545039ns, rc = 0 00000001:00080000:2.0:1787779654.842266:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:2.0:1787779654.842419:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e87450a800) 00010000:00010000:2.0:1787779654.842423:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787779654.842429:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031800/0x9e63ba8af688999a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae63 expref: 32 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779654.842634:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e86c758450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+31:11388:x1874622505095040:12345-192.168.201.9@tcp:35:lfs.0 Request processed in 11177us (11423us total) trans 4294967432 rc 0/0 00000100:00100000:2.0:1787779654.842644:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 38 00000020:00080000:2.0:1787779654.842648:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787779654.845222:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779654.845382:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505095296 00000100:00100000:2.0:1787779654.845391:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505095296 00000100:00100000:2.0:1787779654.845470:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 148 00000100:00100000:2.0:1787779654.845481:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e881dd83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+31:11388:x1874622505095296:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:2.0:1787779654.845506:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779654.845528:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67a00/0x9e63ba8af68899b6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedae6a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779654.845586:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67a00/0x9e63ba8af68899b6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae6a expref: 32 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779654.845600:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67a00/0x9e63ba8af68899b6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae6a expref: 32 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779654.845617:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e84927f000) 00010000:00010000:2.0:1787779654.845621:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787779654.845704:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87aa67a00, rc 0) 00000100:00100000:2.0:1787779654.847579:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e881dd83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+32:11388:x1874622505095296:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 2090us (2353us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779654.847592:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 148 00000100:00100000:0.0:1787779654.851129:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779654.851253:0:11475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505095552 00000100:00100000:2.0:1787779654.851263:0:11475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505095552 00000100:00100000:2.0:1787779654.851331:0:11475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 39 00000100:00100000:2.0:1787779654.851350:0:11475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f5392c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+32:11388:x1874622505095552:12345-192.168.201.9@tcp:35:lfs.0 00000100:00100000:2.0:1787779654.851572:0:11475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f5392c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+33:11388:x1874622505095552:12345-192.168.201.9@tcp:35:lfs.0 Request processed in 231us (451us total) trans 4294967433 rc 0/0 00000100:00100000:2.0:1787779654.851580:0:11475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 39 00000100:00100000:0.0:1787779654.950477:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779654.950666:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505095808 00000100:00100000:3.0:1787779654.950677:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505095808 00000100:00100000:3.0:1787779654.950770:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 149 00000100:00100000:3.0:1787779654.950779:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f53a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+33:11398:x1874622505095808:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:3.0:1787779654.950818:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779654.950839:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031800/0x9e63ba8af68899bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedae71 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787779654.950951:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:3.0:1787779654.951080:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031800/0x9e63ba8af68899bd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae71 expref: 35 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.951095:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e87450a400) 00010000:00010000:3.0:1787779654.951098:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787779654.951103:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031800/0x9e63ba8af68899bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae71 expref: 35 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.951118:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e840031800, rc 0) 00000100:00100000:3.0:1787779654.951175:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f53a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+34:11398:x1874622505095808:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 397us (707us total) trans 4294967434 rc 301/301 00000100:00100000:3.0:1787779654.951183:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 149 00000100:00100000:1.0:1787779654.954873:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779654.954945:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505095936 00000100:00100000:3.0:1787779654.954963:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505095936 00000100:00100000:3.0:1787779654.955021:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 150 00000100:00100000:3.0:1787779654.955031:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e881dd8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+34:11398:x1874622505095936:12345-192.168.201.9@tcp:34:lfs.0 00010000:00010000:3.0:1787779654.955103:0:8197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031a00/0x9e63ba8af68899cb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.955117:0:8197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031a00/0x9e63ba8af68899cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.955128:0:8197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031a00/0x9e63ba8af68899cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.955142:0:8197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030200/0x9e63ba8af68899d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.955149:0:8197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030200/0x9e63ba8af68899d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.955155:0:8197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030200/0x9e63ba8af68899d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.955248:0:8197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030400/0x9e63ba8af68899d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.955256:0:8197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030400/0x9e63ba8af68899d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.955262:0:8197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030400/0x9e63ba8af68899d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787779654.955314:0:8197:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030400/0x9e63ba8af68899d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.955351:0:8197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031a00/0x9e63ba8af68899cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.955357:0:8197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031a00/0x9e63ba8af68899cb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.955363:0:8197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031a00/0x9e63ba8af68899cb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.955369:0:8197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e840031a00 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:3.0:1787779654.955373:0:8197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031a00/0x9e63ba8af68899cb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.955381:0:8197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031a00/0x9e63ba8af68899cb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.955391:0:8197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98e87450a100) 00010000:00010000:3.0:1787779654.955394:0:8197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779654.955399:0:8197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031a00/0x9e63ba8af68899cb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.955405:0:8197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031a00/0x9e63ba8af68899cb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.955419:0:8197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030200/0x9e63ba8af68899d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.955425:0:8197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030200/0x9e63ba8af68899d2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.955430:0:8197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030200/0x9e63ba8af68899d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.955441:0:8197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e840030200 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:3.0:1787779654.955443:0:8197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030200/0x9e63ba8af68899d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.955448:0:8197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030200/0x9e63ba8af68899d2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.955455:0:8197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98e87450a900) 00010000:00010000:3.0:1787779654.955457:0:8197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779654.955460:0:8197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030200/0x9e63ba8af68899d2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.955465:0:8197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030200/0x9e63ba8af68899d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.955479:0:8197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030400/0x9e63ba8af68899d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.955486:0:8197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030400/0x9e63ba8af68899d9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.955491:0:8197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030400/0x9e63ba8af68899d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.955495:0:8197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e840030400 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:3.0:1787779654.955498:0:8197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030400/0x9e63ba8af68899d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.955503:0:8197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030400/0x9e63ba8af68899d9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.955520:0:8197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e84927f000) 00010000:00010000:3.0:1787779654.955522:0:8197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779654.955525:0:8197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030400/0x9e63ba8af68899d9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.955531:0:8197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030400/0x9e63ba8af68899d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779654.955616:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e881dd8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+34:11398:x1874622505095936:12345-192.168.201.9@tcp:34:lfs.0 Request processed in 586us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779654.955624:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 150 00000100:00100000:0.0:1787779654.958566:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779654.958654:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505096192 00000100:00100000:2.0:1787779654.958662:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505096192 00000100:00100000:2.0:1787779654.958748:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 40 00000100:00100000:2.0:1787779654.958758:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f539680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+34:11398:x1874622505096192:12345-192.168.201.9@tcp:35:lfs.0 00000100:00100000:2.0:1787779654.959016:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f539680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+35:11398:x1874622505096192:12345-192.168.201.9@tcp:35:lfs.0 Request processed in 258us (459us total) trans 4294967435 rc 0/0 00000100:00100000:2.0:1787779654.959024:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 40 00000100:00100000:0.0:1787779654.997166:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779654.997292:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505096448 00000100:00100000:3.0:1787779654.997301:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505096448 00000100:00100000:3.0:1787779654.997362:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 151 00000100:00100000:3.0:1787779654.997371:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f538f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+35:11401:x1874622505096448:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:3.0:1787779654.997394:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779654.997412:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030400/0x9e63ba8af68899e0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedae78 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.997479:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030200/0x9e63ba8af68899e7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.997492:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030200/0x9e63ba8af68899e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.997503:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030200/0x9e63ba8af68899e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.997515:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031a00/0x9e63ba8af68899ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.997533:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031a00/0x9e63ba8af68899ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.997538:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031a00/0x9e63ba8af68899ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.997661:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031800/0x9e63ba8af68899f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.997670:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031800/0x9e63ba8af68899f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.997677:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031800/0x9e63ba8af68899f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787779654.997687:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787779654.997833:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030200/0x9e63ba8af68899e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.997840:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030200/0x9e63ba8af68899e7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.997846:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030200/0x9e63ba8af68899e7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.997851:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e840030200 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:3.0:1787779654.997855:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030200/0x9e63ba8af68899e7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.997862:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030200/0x9e63ba8af68899e7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.997882:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98e87450a100) 00010000:00010000:3.0:1787779654.997885:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779654.997889:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030200/0x9e63ba8af68899e7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.997895:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030200/0x9e63ba8af68899e7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.997907:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031a00/0x9e63ba8af68899ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.997913:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031a00/0x9e63ba8af68899ee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.997917:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031a00/0x9e63ba8af68899ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.997922:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e840031a00 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:3.0:1787779654.997924:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031a00/0x9e63ba8af68899ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.997929:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031a00/0x9e63ba8af68899ee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.997934:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98e87450a900) 00010000:00010000:3.0:1787779654.997936:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779654.997938:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031a00/0x9e63ba8af68899ee lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.997943:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031a00/0x9e63ba8af68899ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.998002:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030400/0x9e63ba8af68899e0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae78 expref: 38 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.998014:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031800/0x9e63ba8af68899f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae78 expref: 37 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779654.998020:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e84927f000) 00010000:00010000:3.0:1787779654.998021:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787779654.998023:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e840031800, rc 0) 00000100:00100000:3.0:1787779654.998079:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f538f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+37:11401:x1874622505096448:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 709us (925us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1787779654.998087:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 151 00000100:00100000:1.0:1787779655.002024:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779655.002143:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505096576 00000100:00100000:3.0:1787779655.002152:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505096576 00000100:00100000:3.0:1787779655.002211:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 152 00000100:00100000:3.0:1787779655.002221:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e881dd9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+37:11401:x1874622505096576:12345-192.168.201.9@tcp:54:lfs.0 00010000:00010000:3.0:1787779655.002299:0:8197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e882049c00/0x9e63ba8af6889a03 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779655.002317:0:8197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e882049c00/0x9e63ba8af6889a03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779655.002328:0:8197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e882049c00/0x9e63ba8af6889a03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779655.002365:0:8197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e882049c00/0x9e63ba8af6889a03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779655.002387:0:8197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e882049c00/0x9e63ba8af6889a03 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779655.002393:0:8197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e882049c00/0x9e63ba8af6889a03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779655.002399:0:8197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e882049c00 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:3.0:1787779655.002403:0:8197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e882049c00/0x9e63ba8af6889a03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779655.002411:0:8197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e882049c00/0x9e63ba8af6889a03 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779655.002421:0:8197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e84927f000) 00010000:00010000:3.0:1787779655.002424:0:8197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787779655.002429:0:8197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e882049c00/0x9e63ba8af6889a03 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779655.002435:0:8197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e882049c00/0x9e63ba8af6889a03 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779655.002511:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e881dd9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+37:11401:x1874622505096576:12345-192.168.201.9@tcp:54:lfs.0 Request processed in 291us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779655.002518:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 152 00000100:00100000:0.0:1787779655.005483:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779655.006143:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505096832 00000100:00100000:2.0:1787779655.006154:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505096832 00000100:00100000:2.0:1787779655.006249:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 41 00000100:00100000:2.0:1787779655.006260:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e852b9cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+37:11401:x1874622505096832:12345-192.168.201.9@tcp:35:lfs.0 00000100:00100000:2.0:1787779655.006591:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e852b9cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+38:11401:x1874622505096832:12345-192.168.201.9@tcp:35:lfs.0 Request processed in 332us (1117us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1787779655.006598:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 41 00000100:00100000:0.0:1787779655.214244:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779655.214663:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505097088 00000100:00100000:3.0:1787779655.214674:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505097088 00000100:00100000:3.0:1787779655.214933:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 153 00000100:00100000:3.0:1787779655.214943:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e852b9cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+38:11432:x1874622505097088:12345-192.168.201.9@tcp:101:cat.0 00010000:00010000:3.0:1787779655.215027:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779655.215060:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e882049c00/0x9e63ba8af6889a0a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedae7f expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779655.215151:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e882049a00/0x9e63ba8af6889a11 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779655.215167:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e882049a00/0x9e63ba8af6889a11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779655.215179:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e882049a00/0x9e63ba8af6889a11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787779655.215191:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787779655.215385:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e882049c00/0x9e63ba8af6889a0a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae7f expref: 41 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779655.215402:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e882049a00/0x9e63ba8af6889a11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae7f expref: 40 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779655.215410:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e84927f000) 00010000:00010000:3.0:1787779655.215413:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787779655.215416:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e882049a00, rc 0) 00000100:00100000:3.0:1787779655.215480:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e852b9cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+40:11432:x1874622505097088:12345-192.168.201.9@tcp:101:cat.0 Request processed in 539us (1248us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1787779655.215487:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 153 00000100:00100000:0.0:1787779655.219380:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779655.219448:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779655.219528:0:11475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505097344 00000100:00100000:3.0:1787779655.219538:0:11475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505097344 00000100:00100000:3.0:1787779655.219596:0:11475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 42 00000100:00100000:3.0:1787779655.219606:0:11475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e852b9e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+40:11432:x1874622505097344:12345-192.168.201.9@tcp:35:cat.0 00000100:00100000:3.0:1787779655.220041:0:11475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e852b9e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+41:11432:x1874622505097344:12345-192.168.201.9@tcp:35:cat.0 Request processed in 434us (668us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1787779655.220050:0:11475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 42 00000100:00100000:2.0:1787779655.220480:0:11162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505097472 00000100:00100000:2.0:1787779655.220494:0:11162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505097472 00000100:00100000:2.0:1787779655.220545:0:11162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 12 00000100:00100000:2.0:1787779655.220555:0:11162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e844d2ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+41:2357:x1874622505097472:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787779655.220567:0:11162:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787779655.220594:0:11162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e882049a00/0x9e63ba8af6889a11 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae7f expref: 41 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779655.220615:0:11162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e84927f000) 00010000:00010000:2.0:1787779655.220621:0:11162:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787779655.220651:0:11162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e844d2ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+40:2357:x1874622505097472:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 98us (1203us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779655.220658:0:11162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 12 00010000:00010000:2.0:1787779655.287778:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779655.290185:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779655.290384:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505097728 00000100:00100000:3.0:1787779655.290395:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505097728 00000100:00100000:3.0:1787779655.290453:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 154 00000100:00100000:3.0:1787779655.290462:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e844d2a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+40:11438:x1874622505097728:12345-192.168.201.9@tcp:101:dd.0 00010000:00010000:3.0:1787779655.290484:0:8197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779655.290487:0:8197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787779655.290511:0:8197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030000/0x9e63ba8af6889977 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae55 expref: 40 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779655.290528:0:8197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98e87450a100) 00010000:00010000:3.0:1787779655.290532:0:8197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787779655.290544:0:8197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e882049c00/0x9e63ba8af6889a1f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedae86 expref: -99 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779655.290956:0:8197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e882049a00/0x9e63ba8af6889a26 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779655.290970:0:8197:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031800/0x9e63ba8af68899f5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae78 expref: 40 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779655.290978:0:8197:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e882049a00/0x9e63ba8af6889a26 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779655.291010:0:8197:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031800/0x9e63ba8af68899f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae78 expref: 40 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779655.291043:0:8197:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031800/0x9e63ba8af68899f5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae78 expref: 40 pid: 5835 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779655.291055:0:8197:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e848fd5e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8197:1874622525028224:192.168.201.9@tcp:104: 00000100:00100000:3.0:1787779655.291161:0:8197:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e85191aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1787779655.294239:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779655.294284:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505097856 00000100:00100000:0.0:1787779655.294292:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505097856 00010000:00010000:0.0:1787779655.294354:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031800/0x9e63ba8af68899f5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae78 expref: 41 pid: 5835 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779655.294391:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 63 00000100:00100000:0.0:1787779655.294400:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e847d94850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+41:2359:x1874622505097856:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787779655.294417:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787779655.294424:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031800/0x9e63ba8af68899f5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae78 expref: 41 pid: 5835 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779655.294438:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031800/0x9e63ba8af68899f5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae78 expref: 41 pid: 5835 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779655.294462:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e84927f000) 00010000:00010000:0.0:1787779655.294467:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98e882049a00/0x9e63ba8af6889a26 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779655.294476:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e882049a00/0x9e63ba8af6889a26 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779655.294484:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e882049a00/0x9e63ba8af6889a26 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779655.294500:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787779655.294545:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e847d94850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+41:2359:x1874622505097856:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 146us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779655.294553:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 63 00010000:00010000:3.0:1787779655.296470:0:8197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031800/0x9e63ba8af68899f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae78 expref: 40 pid: 5835 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779655.296496:0:8197:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e848fd5e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8197:1874622525028224:192.168.201.9@tcp:104: 00010000:00010000:3.0:1787779655.296518:0:8197:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98e882049a00/0x9e63ba8af6889a26 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779655.296527:0:8197:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98e882049a00/0x9e63ba8af6889a26 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779655.296532:0:8197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e882049a00/0x9e63ba8af6889a26 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787779655.296552:0:8197:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787779655.297093:0:8197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e882049c00/0x9e63ba8af6889a1f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae86 expref: 41 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779655.297134:0:8197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e882049a00/0x9e63ba8af6889a26 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae86 expref: 40 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779655.297143:0:8197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e84927f000) 00010000:00010000:0.0:1787779655.297146:0:8197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787779655.297149:0:8197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e882049a00, rc 0) 00000100:00100000:0.0:1787779655.297261:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e844d2a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+40:11438:x1874622505097728:12345-192.168.201.9@tcp:101:dd.0 Request processed in 6799us (7086us total) trans 4294967440 rc 0/0 00000100:00100000:0.0:1787779655.297270:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 154 00000100:00100000:0.0:1787779655.300345:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779655.300445:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505098112 00000100:00100000:2.0:1787779655.300455:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505098112 00000100:00100000:2.0:1787779655.300540:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 155 00000100:00100000:2.0:1787779655.300551:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e844d2ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+40:11438:x1874622505098112:12345-192.168.201.9@tcp:36:dd.0 00010000:00010000:2.0:1787779655.301155:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af6889a34 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779655.301175:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af6889a34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779655.301187:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af6889a34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787779655.301534:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967441 00000004:00010000:2.0:1787779655.301564:0:5836:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000005d8d521 reply state 000000005b97a26e transno 4294967442 ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af6889a34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779655.301667:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787779655.302083:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e844d2ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+43:11438:x1874622505098112:12345-192.168.201.9@tcp:36:dd.0 Request processed in 1528us (1802us total) trans 4294967442 rc 0/0 00000100:00100000:2.0:1787779655.302092:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 155 00000020:00080000:2.0:1787779655.302098:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787779655.310800:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af6889a34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779655.310820:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af6889a34 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779655.310828:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af6889a34 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779655.310854:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87aa66200 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:3.0:1787779655.310859:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af6889a34 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779655.310867:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af6889a34 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779655.310886:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e84927f000) 00010000:00010000:3.0:1787779655.310889:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779655.310894:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af6889a34 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779655.310899:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af6889a34 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779655.327366:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779655.327407:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779655.327432:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779655.327464:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779655.327495:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505098624 00000100:00100000:0.0:1787779655.327504:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505098624 00000100:00100000:0.0:1787779655.327550:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 171 00000100:00100000:0.0:1787779655.327560:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e844d28b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54e1e60c-3037-4ae3-b045-838eb9e0ad0b+5:2358:x1874622505098624:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:0.0:1787779655.327654:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e844d28b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54e1e60c-3037-4ae3-b045-838eb9e0ad0b+5:2358:x1874622505098624:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 94us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779655.327662:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 171 00000100:00100000:2.0:1787779655.327825:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505098240 00000100:00100000:2.0:1787779655.327829:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505098240 00000100:00100000:2.0:1787779655.327863:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 304 00000100:00100000:2.0:1787779655.327870:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ebec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+13:2358:x1874622505098240:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:2.0:1787779655.327899:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ebec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+13:2358:x1874622505098240:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 30us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779655.327905:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 304 00000100:00100000:1.0:1787779655.328104:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505098496 00000100:00100000:1.0:1787779655.328109:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505098496 00000100:00100000:1.0:1787779655.328144:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505098368 00000100:00100000:1.0:1787779655.328147:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505098368 00000100:00100000:1.0:1787779655.328179:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 98 00000100:00100000:1.0:1787779655.328186:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e844d29e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+7:2358:x1874622505098496:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:1.0:1787779655.328216:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e844d29e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+7:2358:x1874622505098496:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 31us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779655.328223:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 98 00000100:00100000:1.0:1787779655.328249:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 99 00000100:00100000:1.0:1787779655.328255:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e844d2bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:2358:x1874622505098368:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:1.0:1787779655.328288:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e844d2bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:2358:x1874622505098368:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 33us (856us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779655.328294:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 99 00000100:00080000:1.0:1787779655.328308:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787779655.544843:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779655.544938:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505098752 00000100:00100000:3.0:1787779655.544957:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505098752 00000100:00100000:3.0:1787779655.545016:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 156 00000100:00100000:3.0:1787779655.545025:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e844d2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+42:11452:x1874622505098752:12345-192.168.201.9@tcp:101:stat.0 00010000:00010000:3.0:1787779655.545049:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779655.545072:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e882049c00/0x9e63ba8af6889a3b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedae8d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779655.545145:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031800/0x9e63ba8af6889a42 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779655.545159:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031800/0x9e63ba8af6889a42 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779655.545170:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031800/0x9e63ba8af6889a42 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779655.545199:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030000/0x9e63ba8af6889a49 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779655.545206:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030000/0x9e63ba8af6889a49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779655.545213:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030000/0x9e63ba8af6889a49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779655.545352:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030400/0x9e63ba8af6889a50 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779655.545364:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e882049a00/0x9e63ba8af6889a26 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae86 expref: 43 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779655.545372:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030400/0x9e63ba8af6889a50 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779655.545407:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98e882049a00/0x9e63ba8af6889a26 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae86 expref: 43 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779655.545419:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98e882049a00/0x9e63ba8af6889a26 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae86 expref: 43 pid: 8197 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779655.545432:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e848fd5e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5835:1874622525028352:192.168.201.9@tcp:104: 00000100:00100000:3.0:1787779655.545567:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e85191a840 going to sleep for 11 seconds 00000100:00100000:3.0:1787779655.553492:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e848fd5e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5835:1874622525028352:192.168.201.9@tcp:104: 00000100:00100000:1.0:1787779655.553495:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00010000:00010000:3.0:1787779655.553519:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030400/0x9e63ba8af6889a50 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779655.554022:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505099008 00000100:00100000:2.0:1787779655.554029:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505099008 00000100:00100000:2.0:1787779655.554082:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 43 00000100:00100000:2.0:1787779655.554092:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e881dd92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+44:5598:x1874622505099008:12345-192.168.201.9@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787779655.554408:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e881dd92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+45:5598:x1874622505099008:12345-192.168.201.9@tcp:35:ldlm_bl.0 Request processed in 317us (913us total) trans 4294967443 rc 0/0 00000100:00100000:2.0:1787779655.554417:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 43 00000100:00100000:0.0:1787779655.565486:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779655.565663:0:11162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505099136 00000100:00100000:2.0:1787779655.565675:0:11162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505099136 00010000:00010000:2.0:1787779655.565747:0:11162:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e882049a00/0x9e63ba8af6889a26 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae86 expref: 45 pid: 8197 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779655.565790:0:11162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 64 00000100:00100000:2.0:1787779655.565799:0:11162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e844d29a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+45:2359:x1874622505099136:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787779655.565831:0:11162:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787779655.565838:0:11162:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98e882049a00/0x9e63ba8af6889a26 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae86 expref: 45 pid: 8197 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779655.565849:0:11162:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98e882049a00/0x9e63ba8af6889a26 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae86 expref: 45 pid: 8197 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779655.565873:0:11162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e882049a00/0x9e63ba8af6889a26 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae86 expref: 45 pid: 8197 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779655.565888:0:11162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e84927f000) 00010000:00010000:2.0:1787779655.565893:0:11162:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030400/0x9e63ba8af6889a50 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779655.565901:0:11162:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030400/0x9e63ba8af6889a50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779655.565908:0:11162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030400/0x9e63ba8af6889a50 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779655.565950:0:11162:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787779655.566102:0:11162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e844d29a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+44:2359:x1874622505099136:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 304us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779655.566110:0:11162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 64 00010000:00010000:0.0:1787779655.566198:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030400/0x9e63ba8af6889a50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779655.566219:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030400/0x9e63ba8af6889a50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787779655.566278:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1787779655.566283:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787779655.566309:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030400/0x9e63ba8af6889a50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779655.566322:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030400/0x9e63ba8af6889a50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779655.566342:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031800/0x9e63ba8af6889a42 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779655.566348:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031800/0x9e63ba8af6889a42 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779655.566354:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031800/0x9e63ba8af6889a42 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779655.566360:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e840031800 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:0.0:1787779655.566364:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031800/0x9e63ba8af6889a42 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779655.566371:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031800/0x9e63ba8af6889a42 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779655.566379:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98e87450a100) 00010000:00010000:0.0:1787779655.566382:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787779655.566385:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031800/0x9e63ba8af6889a42 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779655.566399:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031800/0x9e63ba8af6889a42 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779655.566410:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030000/0x9e63ba8af6889a49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779655.566415:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030000/0x9e63ba8af6889a49 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779655.566420:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030000/0x9e63ba8af6889a49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779655.566424:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e840030000 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:0.0:1787779655.566427:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030000/0x9e63ba8af6889a49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779655.566432:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030000/0x9e63ba8af6889a49 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779655.566438:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98e87450a900) 00010000:00010000:0.0:1787779655.566440:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787779655.566442:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030000/0x9e63ba8af6889a49 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779655.566447:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030000/0x9e63ba8af6889a49 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779655.566481:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e882049c00/0x9e63ba8af6889a3b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae8d expref: 44 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779655.566492:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030400/0x9e63ba8af6889a50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae8d expref: 43 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779655.566502:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e84927f000) 00010000:00010000:0.0:1787779655.566504:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787779655.566506:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e840030400, rc 0) 00000100:00100000:0.0:1787779655.566531:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e844d2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+43:11452:x1874622505098752:12345-192.168.201.9@tcp:101:stat.0 Request processed in 21509us (21699us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779655.566538:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 156 00000100:00100000:0.0:1787779655.693698:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779655.693874:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505099392 00000100:00100000:2.0:1787779655.693884:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505099392 00000100:00100000:2.0:1787779655.693945:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 157 00000100:00100000:2.0:1787779655.693954:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e844d2a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+43:11458:x1874622505099392:12345-192.168.201.9@tcp:36:truncate.0 00010000:00010000:2.0:1787779655.694021:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787779655.694047:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030400/0x9e63ba8af6889a50 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae8d expref: 43 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779655.694066:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e84927f000) 00010000:00010000:2.0:1787779655.694071:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787779655.694257:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66a00/0x9e63ba8af6889a57 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779655.694272:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66a00/0x9e63ba8af6889a57 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779655.694282:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66a00/0x9e63ba8af6889a57 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787779655.694341:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967444 00000004:00010000:2.0:1787779655.694365:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a0411835 reply state 0000000064b2fb80 transno 4294967445 ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66a00/0x9e63ba8af6889a57 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779655.694373:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787779655.694475:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e844d2a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+45:11458:x1874622505099392:12345-192.168.201.9@tcp:36:truncate.0 Request processed in 522us (787us total) trans 4294967445 rc 0/0 00000100:00100000:2.0:1787779655.694483:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 157 00000020:00080000:2.0:1787779655.694487:0:5837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787779655.700360:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66a00/0x9e63ba8af6889a57 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779655.700380:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66a00/0x9e63ba8af6889a57 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779655.700388:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66a00/0x9e63ba8af6889a57 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779655.700404:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87aa66a00 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:3.0:1787779655.700410:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66a00/0x9e63ba8af6889a57 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779655.700419:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66a00/0x9e63ba8af6889a57 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779655.700436:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e84927f000) 00010000:00010000:3.0:1787779655.700440:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779655.700445:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66a00/0x9e63ba8af6889a57 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779655.700452:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66a00/0x9e63ba8af6889a57 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779655.973191:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779655.974682:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505099520 00000100:00100000:2.0:1787779655.974700:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505099520 00000100:00100000:2.0:1787779655.974968:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 158 00000100:00100000:2.0:1787779655.974980:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e881dda940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+44:11472:x1874622505099520:12345-192.168.201.9@tcp:101:stat.0 00010000:00010000:2.0:1787779655.975009:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779655.975057:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66a00/0x9e63ba8af6889a5e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedae94 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779655.975121:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af6889a65 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779655.975134:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af6889a65 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779655.975143:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af6889a65 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779655.975154:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af6889a6c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779655.975160:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af6889a6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779655.975165:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af6889a6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779655.975248:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67200/0x9e63ba8af6889a73 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779655.975255:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67200/0x9e63ba8af6889a73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779655.975261:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67200/0x9e63ba8af6889a73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787779655.975296:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1787779655.975300:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787779655.975334:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67200/0x9e63ba8af6889a73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779655.975352:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67200/0x9e63ba8af6889a73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779655.975361:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af6889a65 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779655.975366:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af6889a65 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779655.975373:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af6889a65 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779655.975378:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87aa66200 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:2.0:1787779655.975383:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af6889a65 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779655.975391:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af6889a65 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779655.975403:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98e87450a100) 00010000:00010000:2.0:1787779655.975406:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787779655.975412:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af6889a65 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779655.975418:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af6889a65 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779655.975431:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af6889a6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779655.975436:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af6889a6c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779655.975449:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af6889a6c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779655.975454:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87aa67e00 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:2.0:1787779655.975456:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af6889a6c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779655.975462:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af6889a6c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779655.975470:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98e84927f300) 00010000:00010000:2.0:1787779655.975472:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787779655.975475:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af6889a6c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779655.975481:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af6889a6c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779655.975520:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66a00/0x9e63ba8af6889a5e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae94 expref: 46 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779655.975534:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67200/0x9e63ba8af6889a73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae94 expref: 45 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779655.975540:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e84927f000) 00010000:00010000:2.0:1787779655.975542:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787779655.975545:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87aa67200, rc 0) 00000100:00100000:2.0:1787779655.975619:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e881dda940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+45:11472:x1874622505099520:12345-192.168.201.9@tcp:101:stat.0 Request processed in 642us (2439us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779655.975633:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 158 00000100:00100000:1.0:1787779656.087034:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779656.087149:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505099776 00000100:00100000:2.0:1787779656.087160:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505099776 00000100:00100000:2.0:1787779656.087240:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 159 00000100:00100000:2.0:1787779656.087251:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e881ddb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+45:11482:x1874622505099776:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:2.0:1787779656.087282:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779656.087303:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66a00/0x9e63ba8af6889a7a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedae9b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787779656.087441:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:2.0:1787779656.087562:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66a00/0x9e63ba8af6889a7a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae9b expref: 47 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779656.087577:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e87450a400) 00010000:00010000:2.0:1787779656.087580:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787779656.087586:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66a00/0x9e63ba8af6889a7a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae9b expref: 47 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779656.087601:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87aa66a00, rc 0) 00000100:00100000:2.0:1787779656.088032:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e881ddb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+46:11482:x1874622505099776:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 782us (1005us total) trans 4294967446 rc 301/301 00000100:00100000:2.0:1787779656.088042:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 159 00000100:00080000:1.0:1787779656.089029:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787779656.091211:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779656.091519:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505100032 00000100:00100000:3.0:1787779656.091529:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505100032 00000100:00100000:3.0:1787779656.091597:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 44 00000100:00100000:3.0:1787779656.091606:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e86c75b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+46:11482:x1874622505100032:12345-192.168.201.9@tcp:35:lfs.0 00000100:00100000:3.0:1787779656.091919:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e86c75b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+47:11482:x1874622505100032:12345-192.168.201.9@tcp:35:lfs.0 Request processed in 313us (716us total) trans 4294967447 rc 0/0 00000100:00100000:3.0:1787779656.091951:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 44 00000100:00100000:3.0:1787779656.207828:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779656.213149:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505100288 00000100:00100000:0.0:1787779656.213164:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505100288 00000100:00100000:0.0:1787779656.213233:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 160 00000100:00100000:0.0:1787779656.213242:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e848fd5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+47:11488:x1874622505100288:12345-192.168.201.9@tcp:101:bash.0 00010000:00010000:0.0:1787779656.213267:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787779656.213288:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af6889a88 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedaea2 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.213412:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af6889a8f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.213428:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67200/0x9e63ba8af6889a73 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae94 expref: 48 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.213436:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af6889a8f lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.213470:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67200/0x9e63ba8af6889a73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae94 expref: 48 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.213503:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67200/0x9e63ba8af6889a73 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae94 expref: 48 pid: 5836 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779656.213516:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e844d283c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5835:1874622525028480:192.168.201.9@tcp:104: 00000100:00100000:0.0:1787779656.213623:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e848e73180 going to sleep for 11 seconds 00000100:00100000:0.0:1787779656.220007:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e844d283c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5835:1874622525028480:192.168.201.9@tcp:104: 00010000:00010000:0.0:1787779656.220038:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af6889a8f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779656.221606:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779656.221759:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505100416 00000100:00100000:0.0:1787779656.221767:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505100416 00010000:00010000:0.0:1787779656.221807:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67200/0x9e63ba8af6889a73 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae94 expref: 49 pid: 5836 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779656.221853:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 65 00000100:00100000:0.0:1787779656.221861:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e848fd7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+49:2359:x1874622505100416:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787779656.221876:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787779656.221883:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67200/0x9e63ba8af6889a73 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae94 expref: 49 pid: 5836 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.221896:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67200/0x9e63ba8af6889a73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae94 expref: 49 pid: 5836 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.221920:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67200/0x9e63ba8af6889a73 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae94 expref: 49 pid: 5836 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.221967:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e84927f000) 00010000:00010000:0.0:1787779656.221972:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af6889a8f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.221981:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af6889a8f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.221990:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af6889a8f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.222019:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787779656.222139:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af6889a8f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.222148:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af6889a8f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787779656.222166:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:3.0:1787779656.222335:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af6889a88 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaea2 expref: 50 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.222350:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af6889a8f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaea2 expref: 49 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.222356:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e84927f000) 00010000:00010000:3.0:1787779656.222359:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787779656.222361:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e848f68200, rc 0) 00000100:00100000:0.0:1787779656.222405:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e848fd7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+49:2359:x1874622505100416:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 544us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779656.222414:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 65 00000100:00100000:3.0:1787779656.223107:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e848fd5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+48:11488:x1874622505100288:12345-192.168.201.9@tcp:101:bash.0 Request processed in 9861us (15284us total) trans 4294967448 rc 0/0 00000100:00100000:3.0:1787779656.223116:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 160 00000100:00100000:1.0:1787779656.224992:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779656.225119:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505100672 00000100:00100000:0.0:1787779656.225129:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505100672 00000100:00100000:0.0:1787779656.225194:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 161 00000100:00100000:0.0:1787779656.225205:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e881ddb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+48:11488:x1874622505100672:12345-192.168.201.9@tcp:36:bash.0 00010000:00010000:0.0:1787779656.225882:0:8197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af6889a9d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.225901:0:8197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af6889a9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.225913:0:8197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af6889a9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787779656.226027:0:8197:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967449 00000004:00010000:0.0:1787779656.226052:0:8197:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fb8a7741 reply state 000000008cd794b7 transno 4294967450 ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af6889a9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779656.226073:0:8197:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787779656.226267:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e881ddb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+51:11488:x1874622505100672:12345-192.168.201.9@tcp:36:bash.0 Request processed in 1053us (1272us total) trans 4294967450 rc 0/0 00000100:00100000:0.0:1787779656.226275:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 161 00000020:00080000:0.0:1787779656.226280:0:8197:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787779656.228076:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af6889a9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.228090:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af6889a9d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.228097:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af6889a9d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.228117:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e848f69600 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:3.0:1787779656.228123:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af6889a9d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.228131:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af6889a9d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.228149:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e84927f000) 00010000:00010000:3.0:1787779656.228152:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779656.228158:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af6889a9d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.228165:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af6889a9d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779656.242235:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779656.242335:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505100800 00000100:00100000:2.0:1787779656.242344:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505100800 00000100:00100000:2.0:1787779656.242400:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 162 00000100:00100000:2.0:1787779656.242408:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e881dd8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+50:11488:x1874622505100800:12345-192.168.201.9@tcp:101:bash.0 00010000:00010000:2.0:1787779656.242448:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779656.242469:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66a00/0x9e63ba8af6889aa4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedaea9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779656.242542:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af6889aab lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779656.242566:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af6889a8f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaea2 expref: 51 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779656.242574:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af6889aab lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779656.242606:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af6889a8f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaea2 expref: 51 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779656.242620:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af6889a8f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaea2 expref: 51 pid: 5835 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779656.242634:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87a960000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5836:1874622525028608:192.168.201.9@tcp:104: 00000100:00100000:2.0:1787779656.242752:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e8411ca0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787779656.245902:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87a960000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5836:1874622525028608:192.168.201.9@tcp:104: 00000100:00100000:1.0:1787779656.246411:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00010000:00010000:2.0:1787779656.246459:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af6889aab lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779656.246609:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505100928 00000100:00100000:3.0:1787779656.246617:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505100928 00010000:00010000:3.0:1787779656.246658:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af6889a8f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaea2 expref: 52 pid: 5835 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779656.246695:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 66 00000100:00100000:3.0:1787779656.246705:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e881dd8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+52:2360:x1874622505100928:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787779656.246747:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787779656.246756:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af6889a8f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaea2 expref: 52 pid: 5835 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.246770:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af6889a8f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaea2 expref: 52 pid: 5835 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.246812:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af6889a8f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaea2 expref: 52 pid: 5835 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.246828:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e84927f000) 00010000:00010000:3.0:1787779656.246834:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af6889aab lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.246844:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af6889aab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.246852:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af6889aab lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.246882:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787779656.246910:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af6889aab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779656.246919:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af6889aab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779656.246941:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e881dd8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+51:2360:x1874622505100928:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 236us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779656.246950:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 66 00000004:00200000:2.0:1787779656.247707:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787779656.247748:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787779656.247772:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af6889aab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779656.248327:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66a00/0x9e63ba8af6889aa4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaea9 expref: 51 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779656.248347:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af6889aab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaea9 expref: 50 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779656.248355:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e84927f000) 00010000:00010000:2.0:1787779656.248357:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787779656.248360:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87aa67e00, rc 0) 00000100:00100000:2.0:1787779656.248411:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e881dd8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+50:11488:x1874622505100800:12345-192.168.201.9@tcp:101:bash.0 Request processed in 6004us (6185us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779656.248419:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 162 00000100:00100000:1.0:1787779656.251080:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779656.251160:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505101184 00000100:00100000:2.0:1787779656.251170:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505101184 00000100:00100000:2.0:1787779656.251243:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 45 00000100:00100000:2.0:1787779656.251252:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e881ddad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+50:11488:x1874622505101184:12345-192.168.201.9@tcp:35:bash.0 00000100:00100000:2.0:1787779656.251511:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e881ddad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+51:11488:x1874622505101184:12345-192.168.201.9@tcp:35:bash.0 Request processed in 259us (441us total) trans 4294967451 rc 0/0 00000100:00100000:2.0:1787779656.251519:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 45 00010000:00010000:1.0:1787779656.306943:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779656.347113:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779656.347371:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505101440 00000100:00100000:2.0:1787779656.347382:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505101440 00000100:00100000:2.0:1787779656.347463:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 163 00000100:00100000:2.0:1787779656.347473:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e881dda580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+51:11498:x1874622505101440:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:2.0:1787779656.347499:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779656.347524:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66a00/0x9e63ba8af6889ab2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedaeb0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787779656.347639:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:2.0:1787779656.347964:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66a00/0x9e63ba8af6889ab2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaeb0 expref: 53 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779656.347978:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e87450a400) 00010000:00010000:2.0:1787779656.347981:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787779656.348075:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66a00/0x9e63ba8af6889ab2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaeb0 expref: 53 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779656.348092:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87aa66a00, rc 0) 00000100:00100000:2.0:1787779656.348187:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e881dda580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+52:11498:x1874622505101440:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 715us (1081us total) trans 4294967452 rc 301/301 00000100:00100000:2.0:1787779656.348195:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 163 00000100:00100000:1.0:1787779656.359358:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779656.359450:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505101568 00000100:00100000:3.0:1787779656.359460:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505101568 00000100:00100000:3.0:1787779656.359522:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 164 00000100:00100000:3.0:1787779656.359532:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e881dd9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+52:11498:x1874622505101568:12345-192.168.201.9@tcp:34:lfs.0 00010000:00010000:3.0:1787779656.359609:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031a00/0x9e63ba8af6889ac0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.359628:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031a00/0x9e63ba8af6889ac0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.359640:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031a00/0x9e63ba8af6889ac0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.359672:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030200/0x9e63ba8af6889ac7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.359679:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030200/0x9e63ba8af6889ac7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.359687:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030200/0x9e63ba8af6889ac7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.359818:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030400/0x9e63ba8af6889ace lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.359826:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030400/0x9e63ba8af6889ace lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.359833:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030400/0x9e63ba8af6889ace lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787779656.359880:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030400/0x9e63ba8af6889ace lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.359892:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031a00/0x9e63ba8af6889ac0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.359898:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031a00/0x9e63ba8af6889ac0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.359904:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031a00/0x9e63ba8af6889ac0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.359909:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e840031a00 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:3.0:1787779656.359913:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031a00/0x9e63ba8af6889ac0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.359927:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031a00/0x9e63ba8af6889ac0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.359939:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98e87450a100) 00010000:00010000:3.0:1787779656.359942:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779656.359947:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031a00/0x9e63ba8af6889ac0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.359953:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031a00/0x9e63ba8af6889ac0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.359966:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030200/0x9e63ba8af6889ac7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.359972:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030200/0x9e63ba8af6889ac7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.359977:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030200/0x9e63ba8af6889ac7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.359982:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e840030200 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:3.0:1787779656.359985:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030200/0x9e63ba8af6889ac7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.360004:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030200/0x9e63ba8af6889ac7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.360011:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98e87450aa00) 00010000:00010000:3.0:1787779656.360014:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779656.360017:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030200/0x9e63ba8af6889ac7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.360031:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030200/0x9e63ba8af6889ac7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.360048:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030400/0x9e63ba8af6889ace lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.360054:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030400/0x9e63ba8af6889ace lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.360060:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030400/0x9e63ba8af6889ace lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.360064:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e840030400 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:3.0:1787779656.360067:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030400/0x9e63ba8af6889ace lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.360073:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030400/0x9e63ba8af6889ace lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.360081:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e84927f000) 00010000:00010000:3.0:1787779656.360083:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779656.360086:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030400/0x9e63ba8af6889ace lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.360092:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030400/0x9e63ba8af6889ace lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779656.360168:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e881dd9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+52:11498:x1874622505101568:12345-192.168.201.9@tcp:34:lfs.0 Request processed in 637us (819us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779656.360176:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 164 00000100:00100000:1.0:1787779656.369475:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779656.369604:0:11475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505101824 00000100:00100000:2.0:1787779656.369615:0:11475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505101824 00000100:00100000:2.0:1787779656.369746:0:11475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 46 00000100:00100000:2.0:1787779656.369759:0:11475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e881ddbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+52:11498:x1874622505101824:12345-192.168.201.9@tcp:35:lfs.0 00000100:00100000:2.0:1787779656.370072:0:11475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e881ddbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+53:11498:x1874622505101824:12345-192.168.201.9@tcp:35:lfs.0 Request processed in 315us (603us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1787779656.370081:0:11475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 46 00000100:00100000:1.0:1787779656.425447:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779656.425547:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505102080 00000100:00100000:0.0:1787779656.425556:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505102080 00000100:00100000:0.0:1787779656.425614:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 165 00000100:00100000:0.0:1787779656.425624:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e881dd8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+53:11501:x1874622505102080:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:0.0:1787779656.425651:0:8197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787779656.425671:0:8197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68a00/0x9e63ba8af6889ad5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedaeb7 expref: -99 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.425809:0:8197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af6889adc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.425825:0:8197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af6889adc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.425837:0:8197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af6889adc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.425850:0:8197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af6889ae3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.425856:0:8197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af6889ae3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.425863:0:8197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af6889ae3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.425991:0:8197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68800/0x9e63ba8af6889aea lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.425999:0:8197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68800/0x9e63ba8af6889aea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.426006:0:8197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68800/0x9e63ba8af6889aea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787779656.426014:0:8197:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787779656.426100:0:8197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af6889adc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.426107:0:8197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af6889adc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.426114:0:8197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af6889adc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.426120:0:8197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e848f68000 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:0.0:1787779656.426123:0:8197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af6889adc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.426130:0:8197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af6889adc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.426141:0:8197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98e87450a100) 00010000:00010000:0.0:1787779656.426144:0:8197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787779656.426148:0:8197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af6889adc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.426166:0:8197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af6889adc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.426179:0:8197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af6889ae3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.426184:0:8197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af6889ae3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.426190:0:8197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af6889ae3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.426195:0:8197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e848f69200 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:0.0:1787779656.426197:0:8197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af6889ae3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.426203:0:8197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af6889ae3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.426209:0:8197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98e860e78400) 00010000:00010000:0.0:1787779656.426211:0:8197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787779656.426214:0:8197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af6889ae3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.426219:0:8197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af6889ae3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.426255:0:8197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68a00/0x9e63ba8af6889ad5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaeb7 expref: 56 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.426268:0:8197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68800/0x9e63ba8af6889aea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaeb7 expref: 55 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.426280:0:8197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e84927f000) 00010000:00010000:0.0:1787779656.426282:0:8197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787779656.426285:0:8197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e848f68800, rc 0) 00000100:00100000:0.0:1787779656.426438:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e881dd8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+55:11501:x1874622505102080:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 815us (999us total) trans 4294967454 rc 0/0 00000100:00100000:0.0:1787779656.426447:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 165 00000100:00100000:1.0:1787779656.431683:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779656.431939:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779656.431995:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505102336 00000100:00100000:0.0:1787779656.432004:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505102336 00000100:00100000:0.0:1787779656.432062:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 166 00000100:00100000:0.0:1787779656.432071:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e881dd9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+55:11501:x1874622505102336:12345-192.168.201.9@tcp:54:lfs.0 00010000:00010000:0.0:1787779656.432138:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af6889af8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.432156:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af6889af8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.432167:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af6889af8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.432195:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af6889af8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.432202:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af6889af8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.432209:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af6889af8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.432216:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e848f68200 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:0.0:1787779656.432234:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af6889af8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.432244:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af6889af8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.432261:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e84927f000) 00010000:00010000:0.0:1787779656.432265:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787779656.432269:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af6889af8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.432276:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af6889af8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779656.432346:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e881dd9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+55:11501:x1874622505102336:12345-192.168.201.9@tcp:54:lfs.0 Request processed in 275us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779656.432353:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 166 00000100:00100000:2.0:1787779656.435103:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505102208 00000100:00100000:2.0:1787779656.435132:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505102208 00000100:00100000:1.0:1787779656.438037:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 13 00000100:00100000:1.0:1787779656.438058:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e881ddb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+55:2360:x1874622505102208:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787779656.438077:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787779656.438106:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68800/0x9e63ba8af6889aea lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaeb7 expref: 55 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779656.438134:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00010000:00010000:1.0:1787779656.438142:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e84927f000) 00010000:00010000:1.0:1787779656.438147:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787779656.438205:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e881ddb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+54:2360:x1874622505102208:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 151us (6532us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779656.438212:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 13 00000100:00100000:3.0:1787779656.438531:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505102592 00000100:00100000:3.0:1787779656.438540:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505102592 00000100:00100000:3.0:1787779656.438580:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 47 00000100:00100000:3.0:1787779656.438587:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e844d283c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+54:11501:x1874622505102592:12345-192.168.201.9@tcp:35:lfs.0 00000100:00100000:3.0:1787779656.438809:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e844d283c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+55:11501:x1874622505102592:12345-192.168.201.9@tcp:35:lfs.0 Request processed in 222us (676us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1787779656.438817:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 47 00000100:00100000:0.0:1787779656.544193:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779656.544325:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505102848 00000100:00100000:2.0:1787779656.544337:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505102848 00000100:00100000:2.0:1787779656.544402:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 167 00000100:00100000:2.0:1787779656.544414:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e844d28f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+55:11518:x1874622505102848:12345-192.168.201.9@tcp:101:cat.0 00010000:00010000:2.0:1787779656.544443:0:8197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779656.544470:0:8197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66a00/0x9e63ba8af6889aff lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedaebe expref: -99 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779656.544573:0:8197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af6889b06 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779656.544596:0:8197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af6889b06 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779656.544609:0:8197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af6889b06 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787779656.544621:0:8197:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787779656.544782:0:8197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66a00/0x9e63ba8af6889aff lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaebe expref: 58 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779656.544813:0:8197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af6889b06 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaebe expref: 57 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779656.544822:0:8197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e84927f000) 00010000:00010000:2.0:1787779656.544825:0:8197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787779656.544828:0:8197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87aa66200, rc 0) 00000100:00100000:2.0:1787779656.544937:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e844d28f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+57:11518:x1874622505102848:12345-192.168.201.9@tcp:101:cat.0 Request processed in 526us (755us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1787779656.544959:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 167 00000100:00100000:0.0:1787779656.575646:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779656.575738:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505102976 00000100:00100000:3.0:1787779656.575747:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505102976 00000100:00100000:3.0:1787779656.575812:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 168 00000100:00100000:3.0:1787779656.575822:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e844d29680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+57:11520:x1874622505102976:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:3.0:1787779656.575847:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779656.575864:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030400/0x9e63ba8af6889b14 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedaec5 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.575918:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030200/0x9e63ba8af6889b1b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.575929:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030200/0x9e63ba8af6889b1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.575936:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030200/0x9e63ba8af6889b1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787779656.575985:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1787779656.575988:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787779656.576002:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030200/0x9e63ba8af6889b1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.576021:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030400/0x9e63ba8af6889b14 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaec5 expref: 59 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.576049:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030200/0x9e63ba8af6889b1b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaec5 expref: 58 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.576058:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98e87450a100) 00010000:00010000:3.0:1787779656.576061:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787779656.576064:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e840030200, rc 0) 00000100:00100000:3.0:1787779656.576237:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e844d29680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+58:11520:x1874622505102976:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 417us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779656.576243:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 168 00000100:00100000:1.0:1787779656.580869:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779656.581031:0:11475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505103360 00000100:00100000:2.0:1787779656.581042:0:11475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505103360 00000100:00100000:2.0:1787779656.581351:0:11475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 48 00000100:00100000:2.0:1787779656.581363:0:11475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e881dd92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+58:11520:x1874622505103360:12345-192.168.201.9@tcp:35:lfs.0 00000100:00100000:2.0:1787779656.581706:0:11475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e881dd92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+59:11520:x1874622505103360:12345-192.168.201.9@tcp:35:lfs.0 Request processed in 346us (925us total) trans 4294967457 rc 0/0 00000100:00100000:2.0:1787779656.581743:0:11475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 48 00000100:00100000:0.0:1787779656.585000:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779656.585414:0:11162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505103488 00000100:00100000:2.0:1787779656.585424:0:11162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505103488 00000100:00100000:2.0:1787779656.585493:0:11162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 14 00000100:00100000:2.0:1787779656.585504:0:11162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e844d292c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+59:11520:x1874622505103488:12345-192.168.201.9@tcp:103:lfs.0 00010000:00010000:2.0:1787779656.585522:0:11162:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787779656.585551:0:11162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af6889aab lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaea9 expref: 59 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779656.585572:0:11162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af6889b06 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaebe expref: 58 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779656.585584:0:11162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67a00/0x9e63ba8af68899b6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae6a expref: 57 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779656.585593:0:11162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e84927f000) 00010000:00010000:2.0:1787779656.585612:0:11162:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787779656.585794:0:11162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e844d292c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+56:11520:x1874622505103488:12345-192.168.201.9@tcp:103:lfs.0 Request processed in 282us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779656.586528:0:11162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 14 00000100:00100000:0.0:1787779656.590062:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779656.590243:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505103616 00000100:00100000:3.0:1787779656.590264:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505103616 00000100:00100000:3.0:1787779656.590339:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 169 00000100:00100000:3.0:1787779656.590351:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e844d2a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+56:11520:x1874622505103616:12345-192.168.201.9@tcp:58:lfs.0 00010000:00010000:3.0:1787779656.590478:0:8197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030400/0x9e63ba8af6889b22 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.590497:0:8197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030400/0x9e63ba8af6889b22 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.590510:0:8197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030400/0x9e63ba8af6889b22 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787779656.590705:0:8197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1787779656.590823:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e844d2a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+56:11520:x1874622505103616:12345-192.168.201.9@tcp:58:lfs.0 Request processed in 474us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779656.590831:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 169 00000100:00100000:1.0:1787779656.607697:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779656.607852:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505103744 00000100:00100000:2.0:1787779656.607863:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505103744 00000100:00100000:2.0:1787779656.607967:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 170 00000100:00100000:2.0:1787779656.607978:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e881dda1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+56:11522:x1874622505103744:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:2.0:1787779656.608001:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779656.608023:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67a00/0x9e63ba8af6889b29 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedaecc expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779656.608142:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af6889b30 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779656.608157:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af6889b30 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779656.608168:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af6889b30 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779656.608180:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af6889b37 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779656.608184:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af6889b37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779656.608188:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af6889b37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779656.608273:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66a00/0x9e63ba8af6889b3e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779656.608287:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66a00/0x9e63ba8af6889b3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779656.608291:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66a00/0x9e63ba8af6889b3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787779656.608336:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787779656.608340:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787779656.608355:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66a00/0x9e63ba8af6889b3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779656.608364:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66a00/0x9e63ba8af6889b3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779656.608370:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af6889b30 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779656.608374:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af6889b30 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779656.608378:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af6889b30 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779656.608382:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87aa66200 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:2.0:1787779656.608385:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af6889b30 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779656.608390:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af6889b30 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779656.608398:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98e87450a100) 00010000:00010000:2.0:1787779656.608400:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787779656.608409:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af6889b30 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779656.608413:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af6889b30 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779656.608422:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af6889b37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779656.608425:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af6889b37 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779656.608429:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af6889b37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779656.608432:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87aa67e00 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:2.0:1787779656.608434:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af6889b37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779656.608437:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af6889b37 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779656.608441:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98e84927f000) 00010000:00010000:2.0:1787779656.608442:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787779656.608444:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af6889b37 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779656.608447:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af6889b37 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779656.608473:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67a00/0x9e63ba8af6889b29 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaecc expref: 58 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779656.608489:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66a00/0x9e63ba8af6889b3e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaecc expref: 57 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779656.608495:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e87450aa00) 00010000:00010000:2.0:1787779656.608496:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787779656.608497:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87aa66a00, rc 0) 00000100:00100000:2.0:1787779656.608541:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e881dda1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+57:11522:x1874622505103744:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 567us (857us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779656.608546:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 170 00000040:00080000:1.0:1787779656.691118:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787779656.691128:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787779656.691166:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1787779656.691174:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787779656.691335:0:11684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e845c70000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11684:1874622525028736:192.168.201.9@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787779656.691443:0:11684:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e87a7166c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787779656.696515:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779656.696621:0:11684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e845c70000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11684:1874622525028736:192.168.201.9@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787779656.696897:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505103872 00000100:00100000:0.0:1787779656.696904:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505103872 00000100:00100000:0.0:1787779656.696963:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 171 00000100:00100000:0.0:1787779656.696973:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e845c72d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+57:11533:x1874622505103872:12345-192.168.201.9@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787779656.697003:0:8197:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787779656.697107:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e845c72d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+57:11533:x1874622505103872:12345-192.168.201.9@tcp:53:lhsmtool_posix.0 Request processed in 134us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779656.697122:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 171 00000100:00100000:0.0:1787779656.699873:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779656.699946:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505104000 00000100:00100000:3.0:1787779656.699955:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505104000 00000100:00100000:3.0:1787779656.700014:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 172 00000100:00100000:3.0:1787779656.700023:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e844d2b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+57:11533:x1874622505104000:12345-192.168.201.9@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787779656.700095:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031a00/0x9e63ba8af6889b45 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.700112:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031a00/0x9e63ba8af6889b45 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.700126:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031a00/0x9e63ba8af6889b45 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.700141:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030000/0x9e63ba8af6889b4c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.700149:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030000/0x9e63ba8af6889b4c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.700156:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030000/0x9e63ba8af6889b4c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.700183:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031800/0x9e63ba8af6889b53 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.700192:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031800/0x9e63ba8af6889b53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.700199:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031800/0x9e63ba8af6889b53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787779656.700241:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787779656.700271:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787779656.700288:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031800/0x9e63ba8af6889b53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.700300:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031a00/0x9e63ba8af6889b45 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.700316:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031a00/0x9e63ba8af6889b45 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.700324:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031a00/0x9e63ba8af6889b45 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.700330:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e840031a00 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:3.0:1787779656.700335:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031a00/0x9e63ba8af6889b45 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.700344:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031a00/0x9e63ba8af6889b45 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.700357:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98e84927fc00) 00010000:00010000:3.0:1787779656.700360:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779656.700365:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031a00/0x9e63ba8af6889b45 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.700371:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031a00/0x9e63ba8af6889b45 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.700388:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030000/0x9e63ba8af6889b4c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.700394:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030000/0x9e63ba8af6889b4c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.700410:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030000/0x9e63ba8af6889b4c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.700415:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e840030000 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:3.0:1787779656.700424:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030000/0x9e63ba8af6889b4c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.700432:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030000/0x9e63ba8af6889b4c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.700441:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff98e87450a700) 00010000:00010000:3.0:1787779656.700444:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779656.700447:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030000/0x9e63ba8af6889b4c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.700453:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030000/0x9e63ba8af6889b4c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.700473:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031800/0x9e63ba8af6889b53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.700480:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031800/0x9e63ba8af6889b53 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.700485:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031800/0x9e63ba8af6889b53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.700490:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e840031800 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:3.0:1787779656.700493:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031800/0x9e63ba8af6889b53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.700508:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031800/0x9e63ba8af6889b53 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.700516:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e87450aa00) 00010000:00010000:3.0:1787779656.700518:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779656.700521:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031800/0x9e63ba8af6889b53 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.700526:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031800/0x9e63ba8af6889b53 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779656.700606:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e844d2b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+57:11533:x1874622505104000:12345-192.168.201.9@tcp:34:lhsmtool_posix.0 Request processed in 583us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779656.700615:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 172 00000100:00100000:3.0:1787779656.705669:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779656.705803:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505104256 00000100:00100000:0.0:1787779656.705812:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505104256 00000100:00100000:0.0:1787779656.706014:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 173 00000100:00100000:0.0:1787779656.706025:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e848fd4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+57:11533:x1874622505104256:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787779656.706045:0:8197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787779656.706065:0:8197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af6889b5a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedaed3 expref: -99 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.706165:0:8197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af6889b61 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.706180:0:8197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af6889b61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.706193:0:8197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af6889b61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787779656.706211:0:8197:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787779656.706333:0:8197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af6889b61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.706341:0:8197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af6889b61 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.706348:0:8197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af6889b61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.706354:0:8197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e848f69600 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:0.0:1787779656.706365:0:8197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af6889b61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.706373:0:8197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af6889b61 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.706385:0:8197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e87450aa00) 00010000:00010000:0.0:1787779656.706388:0:8197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787779656.706393:0:8197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af6889b61 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.706399:0:8197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af6889b61 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.706437:0:8197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af6889b5a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaed3 expref: 59 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.706448:0:8197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98e84927fc00) 00010000:00010000:0.0:1787779656.706451:0:8197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787779656.706455:0:8197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af6889b5a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaed3 expref: 59 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.706464:0:8197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e848f69800, rc 0) 00000100:00100000:0.0:1787779656.706535:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e848fd4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+58:11533:x1874622505104256:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 Request processed in 512us (875us total) trans 4294967458 rc 301/301 00000100:00100000:0.0:1787779656.706543:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 173 00000100:00100000:3.0:1787779656.710285:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779656.716744:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505104384 00000100:00100000:1.0:1787779656.716759:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505104384 00000100:00100000:1.0:1787779656.717002:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 174 00000100:00100000:1.0:1787779656.717013:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e848fd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+58:11533:x1874622505104384:12345-192.168.201.9@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787779656.717055:0:5837:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787779656.717185:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e848fd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+58:11533:x1874622505104384:12345-192.168.201.9@tcp:53:lhsmtool_posix.0 Request processed in 173us (6907us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779656.717193:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 174 00000100:00100000:0.0:1787779656.733200:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779656.733339:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505104640 00000100:00100000:1.0:1787779656.733349:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505104640 00000100:00100000:1.0:1787779656.733411:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 175 00000100:00100000:1.0:1787779656.733427:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e844d2b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+58:11533:x1874622505104640:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787779656.733450:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779656.733454:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787779656.733482:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030200/0x9e63ba8af6889b1b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaec5 expref: 58 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779656.733501:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98e87450a100) 00010000:00010000:1.0:1787779656.733507:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787779656.733521:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af6889b6f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedaeda expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787779656.733945:0:5836:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:1.0:1787779656.734150:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98be00/0x9e63ba8af6889b76 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779656.734164:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98be00/0x9e63ba8af6889b76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779656.734174:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98be00/0x9e63ba8af6889b76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779656.734225:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af6889b6f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaeda expref: 60 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779656.734239:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98be00/0x9e63ba8af6889b76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaeda expref: 59 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779656.734246:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98e860c40300) 00010000:00010000:1.0:1787779656.734249:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787779656.734257:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87a98be00, rc 0) 00000100:00100000:1.0:1787779656.734332:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e844d2b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+59:11533:x1874622505104640:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 Request processed in 906us (1141us total) trans 4294967459 rc 0/0 00000100:00100000:1.0:1787779656.734341:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 175 00000100:00100000:1.0:1787779656.737447:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779656.737523:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505104896 00000100:00100000:2.0:1787779656.737533:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505104896 00000100:00100000:2.0:1787779656.737589:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 176 00000100:00100000:2.0:1787779656.737599:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e845c72580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+59:11533:x1874622505104896:12345-192.168.201.9@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787779656.737657:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787779656.737682:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98be00/0x9e63ba8af6889b76 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaeda expref: 59 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779656.737700:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98e860c40300) 00010000:00010000:2.0:1787779656.737743:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787779656.737767:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af6889b84 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779656.737781:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af6889b84 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779656.737790:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af6889b84 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779656.737816:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af6889b8b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xbaaaace5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779656.737824:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af6889b8b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xbaaaace5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779656.737831:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af6889b8b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xbaaaace5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779656.737901:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af6889b84 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779656.737909:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af6889b84 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779656.737915:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af6889b84 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779656.737922:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87aa67e00 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:2.0:1787779656.737925:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af6889b84 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779656.737933:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af6889b84 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779656.737942:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98e87450a100) 00010000:00010000:2.0:1787779656.737945:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787779656.737949:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af6889b84 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779656.737955:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af6889b84 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779656.737972:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af6889b8b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xbaaaace5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779656.737978:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af6889b8b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xbaaaace5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779656.737984:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af6889b8b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xbaaaace5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779656.737989:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87aa66200 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:2.0:1787779656.737992:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af6889b8b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xbaaaace5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779656.737998:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af6889b8b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xbaaaace5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779656.738005:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xbaaaace5 (ffff98e84927f000) 00010000:00010000:2.0:1787779656.738007:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787779656.738010:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af6889b8b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xbaaaace5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779656.738016:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af6889b8b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xbaaaace5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779656.738092:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e845c72580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+58:11533:x1874622505104896:12345-192.168.201.9@tcp:36:lhsmtool_posix.0 Request processed in 494us (654us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787779656.739548:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 176 00000100:00100000:2.0:1787779656.740456:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779656.740686:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505105024 00000100:00100000:3.0:1787779656.740695:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505105024 00000100:00100000:3.0:1787779656.740769:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 177 00000100:00100000:3.0:1787779656.740779:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e88195c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+58:11533:x1874622505105024:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787779656.740800:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779656.740822:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031800/0x9e63ba8af6889b92 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedaee1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.740857:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030000/0x9e63ba8af6889b99 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.740869:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030000/0x9e63ba8af6889b99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.740891:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030000/0x9e63ba8af6889b99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.740983:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031800/0x9e63ba8af6889b92 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaee1 expref: 60 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.741001:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030000/0x9e63ba8af6889b99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaee1 expref: 59 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.741009:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98e87450a700) 00010000:00010000:3.0:1787779656.741012:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787779656.741015:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e840030000, rc 0) 00000100:00100000:3.0:1787779656.741070:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e88195c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+59:11533:x1874622505105024:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 Request processed in 293us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779656.741076:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 177 00000100:00100000:0.0:1787779656.745314:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779656.745620:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505105280 00000100:00100000:3.0:1787779656.745629:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505105280 00000100:00100000:3.0:1787779656.745692:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 178 00000100:00100000:3.0:1787779656.745703:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e844d28780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+59:11533:x1874622505105280:12345-192.168.201.9@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787779656.745807:0:8197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031a00/0x9e63ba8af6889ba0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.745826:0:8197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031a00/0x9e63ba8af6889ba0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.745838:0:8197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031a00/0x9e63ba8af6889ba0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787779656.747073:0:8197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:3.0:1787779656.747087:0:8197:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 422488375057ns, next at 423488372480ns, rc = 0 00000004:00010000:3.0:1787779656.747414:0:8197:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000049df0389 reply state 0000000043c68799 transno 4294967460 ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031a00/0x9e63ba8af6889ba0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779656.747424:0:8197:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787779656.748280:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e844d28780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+61:11533:x1874622505105280:12345-192.168.201.9@tcp:36:lhsmtool_posix.0 Request processed in 2574us (2982us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1787779656.748290:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 178 00010000:00010000:3.0:1787779656.760696:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031a00/0x9e63ba8af6889ba0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.760733:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031a00/0x9e63ba8af6889ba0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.760742:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031a00/0x9e63ba8af6889ba0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.760749:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e840031a00 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:3.0:1787779656.760754:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031a00/0x9e63ba8af6889ba0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.760763:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031a00/0x9e63ba8af6889ba0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.760780:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98e87450a700) 00010000:00010000:3.0:1787779656.760783:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787779656.760788:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031a00/0x9e63ba8af6889ba0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.760806:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031a00/0x9e63ba8af6889ba0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779656.765275:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779656.766459:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505105408 00000100:00100000:3.0:1787779656.766473:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505105408 00000100:00100000:3.0:1787779656.766571:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 179 00000100:00100000:3.0:1787779656.766582:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e844d28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+60:11533:x1874622505105408:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787779656.766607:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779656.766636:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031800/0x9e63ba8af6889ba7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedaee8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.766790:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031800/0x9e63ba8af6889ba7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaee8 expref: 61 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.766805:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031800/0x9e63ba8af6889ba7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaee8 expref: 61 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.766824:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98e87450a700) 00010000:00010000:3.0:1787779656.766827:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787779656.766830:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e840031800, rc 0) 00000100:00100000:3.0:1787779656.766890:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e844d28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+61:11533:x1874622505105408:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 Request processed in 311us (1628us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779656.766897:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 179 00000100:00100000:2.0:1787779656.769192:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779656.769391:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505105536 00000100:00100000:3.0:1787779656.769401:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505105536 00000100:00100000:3.0:1787779656.769493:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 51 00000100:00100000:3.0:1787779656.769504:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e848f34780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+6:2359:x1874622505105536:12345-192.168.201.9@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787779656.769974:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e848f34780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+7:2359:x1874622505105536:12345-192.168.201.9@tcp:2:lhsmtool_posix.0 Request processed in 471us (792us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1787779656.769982:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 51 00000100:00100000:2.0:1787779656.772559:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779656.772621:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505105792 00000100:00100000:1.0:1787779656.772632:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505105792 00000100:00100000:1.0:1787779656.772777:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 49 00000100:00100000:1.0:1787779656.772786:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec18f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+61:11533:x1874622505105792:12345-192.168.201.9@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787779656.773929:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec18f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+62:11533:x1874622505105792:12345-192.168.201.9@tcp:35:lhsmtool_posix.0 Request processed in 1138us (1374us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1787779656.773939:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 49 00000100:00100000:3.0:1787779656.778221:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779656.778273:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505106048 00000100:00100000:1.0:1787779656.778284:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505106048 00000100:00100000:1.0:1787779656.778357:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 180 00000100:00100000:1.0:1787779656.778367:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e848fd5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+62:11533:x1874622505106048:12345-192.168.201.9@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787779656.778486:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e848fd5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+62:11533:x1874622505106048:12345-192.168.201.9@tcp:57:lhsmtool_posix.0 Request processed in 119us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779656.778494:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 180 00000100:00100000:2.0:1787779656.793286:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779656.793370:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505106176 00000100:00100000:3.0:1787779656.793379:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505106176 00000100:00100000:3.0:1787779656.793440:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 181 00000100:00100000:3.0:1787779656.793449:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec192c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+62:11533:x1874622505106176:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787779656.793469:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779656.793499:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030200/0x9e63ba8af6889bae lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedaeef expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.793591:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031a00/0x9e63ba8af6889bb5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.793605:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031a00/0x9e63ba8af6889bb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.793617:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031a00/0x9e63ba8af6889bb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787779656.793652:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787779656.793668:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031a00/0x9e63ba8af6889bb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.793693:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030200/0x9e63ba8af6889bae lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaeef expref: 64 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.793737:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031a00/0x9e63ba8af6889bb5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaeef expref: 63 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.793752:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98e87450a700) 00010000:00010000:3.0:1787779656.793755:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787779656.793758:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e840031a00, rc 0) 00000100:00100000:3.0:1787779656.793810:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec192c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+63:11533:x1874622505106176:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 Request processed in 363us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779656.793817:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 181 00000100:00100000:3.0:1787779656.802475:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779656.802564:0:10229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505106304 00000100:00100000:1.0:1787779656.802574:0:10229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505106304 00000100:00100000:1.0:1787779656.802679:0:10229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 52 00000100:00100000:1.0:1787779656.802691:0:10229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e848fd61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+7:2359:x1874622505106304:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787779656.802738:0:10229:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779656.802761:0:10229:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c48a6216/0x9e63ba8af6889bbc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedaef6 expref: -99 pid: 10229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787779656.802802:0:10229:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8f5a48, blocks: 0x1 00010000:00010000:1.0:1787779656.802823:0:10229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=422s v=(0 0) 00010000:00010000:1.0:1787779656.802828:0:10229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787779656.802837:0:10229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c48a6216/0x9e63ba8af6889bbc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaef6 expref: 8 pid: 10229 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779656.802867:0:10229:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c48a6216/0x9e63ba8af6889bbc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaef6 expref: 8 pid: 10229 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779656.802881:0:10229:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87a98a600, rc 0) 00000100:00100000:1.0:1787779656.802951:0:10229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e848fd61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+8:2359:x1874622505106304:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 Request processed in 262us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779656.802958:0:10229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 52 00000100:00100000:3.0:1787779656.809448:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779656.809656:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505106560 00000100:00100000:1.0:1787779656.809666:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505106560 00000100:00100000:1.0:1787779656.809814:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 182 00000100:00100000:1.0:1787779656.809824:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e848fd43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+63:11533:x1874622505106560:12345-192.168.201.9@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787779656.809951:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e848fd43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+63:11533:x1874622505106560:12345-192.168.201.9@tcp:57:lhsmtool_posix.0 Request processed in 128us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779656.809958:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 182 00000100:00100000:3.0:1787779656.817076:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779656.817647:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505106688 00000100:00100000:1.0:1787779656.817657:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505106688 00000100:00100000:1.0:1787779656.817814:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 53 00000100:00100000:1.0:1787779656.817824:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e848fd4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+8:11533:x1874622505106688:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787779656.817856:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779656.817874:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000807640ef/0x9e63ba8af6889bc3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedaefd expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779656.817902:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c48a6216/0x9e63ba8af6889bbc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaef6 expref: 9 pid: 10229 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779656.817910:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787779656.817914:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787779656.817918:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000807640ef/0x9e63ba8af6889bc3 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaefd expref: 9 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779656.817947:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c48a6216/0x9e63ba8af6889bbc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaef6 expref: 9 pid: 10229 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779656.817959:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c48a6216/0x9e63ba8af6889bbc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaef6 expref: 9 pid: 10229 timeout: 522 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779656.817971:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e845c71e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6681:1874622525028864:192.168.201.9@tcp:104: 00000100:00100000:1.0:1787779656.818049:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e87a716480 going to sleep for 11 seconds 00000100:00100000:0.0:1787779656.823591:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779656.823684:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505106816 00000100:00100000:3.0:1787779656.823693:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505106816 00000100:00100000:1.0:1787779656.823724:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e845c71e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6681:1874622525028864:192.168.201.9@tcp:104: 00010000:00010000:1.0:1787779656.823761:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000807640ef/0x9e63ba8af6889bc3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaefd expref: 10 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.823769:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c48a6216/0x9e63ba8af6889bbc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaef6 expref: 10 pid: 10229 timeout: 522 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779656.823784:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87a98a400, rc 0) 00000100:00100000:3.0:1787779656.823815:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 67 00000100:00100000:3.0:1787779656.823826:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ab1b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+10:2360:x1874622505106816:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787779656.823840:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1787779656.823845:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e848fd4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+10:11533:x1874622505106688:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 Request processed in 6021us (6777us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779656.823853:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 53 00010000:00010000:3.0:1787779656.824026:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c48a6216/0x9e63ba8af6889bbc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaef6 expref: 9 pid: 10229 timeout: 522 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.824042:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c48a6216/0x9e63ba8af6889bbc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaef6 expref: 9 pid: 10229 timeout: 522 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.824069:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c48a6216/0x9e63ba8af6889bbc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaef6 expref: 9 pid: 10229 timeout: 522 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.824095:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787779656.824100:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787779656.824178:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000807640ef/0x9e63ba8af6889bc3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaefd expref: 8 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.824189:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000807640ef/0x9e63ba8af6889bc3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaefd expref: 8 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.824224:0:5822:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000807640ef/0x9e63ba8af6889bc3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaefd expref: 8 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779656.824238:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e848fd5680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5822:1874622525028992:192.168.201.9@tcp:105: 00000100:00100000:3.0:1787779656.824360:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e85191a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787779656.827658:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779656.827740:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505106944 00000100:00100000:1.0:1787779656.827749:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505106944 00002000:00100000:1.0:1787779656.827795:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff98e848fd52c0 x1874622505106944/t0(0) o4->e225400f-8d32-48a8-ab5e-fe4d3780a20c@192.168.201.9@tcp:67/0 lens 504/0 e 0 to 0 dl 1787779667 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787779656.827806:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98e848fd52c0 with x1874622505106944 ext(0->8) 00002000:00010000:1.0:1787779656.827811:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98e848fd52c0 00000100:00100000:1.0:1787779656.827843:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 5 00000100:00100000:1.0:1787779656.827853:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e848fd52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+9:2360:x1874622505106944:12345-192.168.201.9@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787779656.828471:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e848fd52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+11:2360:x1874622505106944:12345-192.168.201.9@tcp:4:lhsmtool_posix.0 Request processed in 617us (823us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1787779656.828479:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 5 00002000:00100000:1.0:1787779656.828486:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff98e848fd52c0 x1874622505106944/t4294967314(0) o4->e225400f-8d32-48a8-ab5e-fe4d3780a20c@192.168.201.9@tcp:67/0 lens 504/448 e 0 to 0 dl 1787779667 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787779656.828493:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98e848fd52c0 with x1874622505106944 ext(0->8) 00002000:00010000:1.0:1787779656.828496:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98e848fd52c0 00000100:00100000:2.0:1787779656.829490:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e848fd5680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5822:1874622525028992:192.168.201.9@tcp:105: 00010000:00010000:2.0:1787779656.829511:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787779656.829556:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ab1b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+10:2360:x1874622505106816:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 5732us (5976us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779656.829565:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 67 00000100:00100000:3.0:1787779656.838565:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779656.838648:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505107072 00000100:00100000:2.0:1787779656.838656:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505107072 00000100:00100000:2.0:1787779656.838704:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 183 00000100:00100000:2.0:1787779656.838735:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e848fd6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+63:11533:x1874622505107072:12345-192.168.201.9@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787779656.875320:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967458 is committed 00000001:00080000:1.0:1787779656.875408:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967461 is committed 00000004:00080000:1.0:1787779656.875452:0:5857:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:1.0:1787779656.875478:0:5857:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98e84721d0c0 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1787779656.875483:0:5857:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98e87f009600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98e84721d000 00000020:00080000:1.0:1787779656.875487:0:5857:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98e87f009a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98e87f4ff800 00000004:00080000:1.0:1787779656.875511:0:5857:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000100:00100000:2.0:1787779656.875525:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e848fd6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+36:11533:x1874622505107072:12345-192.168.201.9@tcp:44:lhsmtool_posix.0 Request processed in 36808us (36963us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779656.875538:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 183 00000100:00100000:2.0:1787779656.875600:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e848fd7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622525029120:0@lo:6:osp-syn-1-0.0 00000020:00080000:0.0:1787779656.875626:0:5868:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000100:00100000:2.0:1787779656.875656:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779656.875678:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787779656.875693:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e845c71e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874622525029248:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787779656.875755:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779656.875784:0:10229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525029120 00000100:00100000:2.0:1787779656.875791:0:10229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525029120 00000100:00080000:1.0:1787779656.875831:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00080000:0.0:1787779656.875835:0:5868:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1787779656.875838:0:10229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525029248 00000100:00100000:2.0:1787779656.875841:0:10229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525029248 00000100:00100000:0.0:1787779656.875856:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1787779656.875866:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787779656.875866:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1874622525029120:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787779656.875874:0:10229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787779656.875880:0:10229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e845c73c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874622525029248:12345-0@lo:2:osp-syn-0-0.0 00002000:00080000:0.0:1787779656.875891:0:6680:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:0.0:1787779656.875918:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a8f5a46, atime: 0x6a8f5a46, ctime: 0x6a8f5a46, blocks: 0x1 00010000:00010000:0.0:1787779656.875926:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000304b3d25/0x9e63ba8af6889bca lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.875942:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=422s v=(0 0) 00010000:00010000:0.0:1787779656.875946:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787779656.875953:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000304b3d25/0x9e63ba8af6889bca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.875970:0:6680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000304b3d25/0x9e63ba8af6889bca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.875981:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000304b3d25/0x9e63ba8af6889bca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.875988:0:6680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000304b3d25/0x9e63ba8af6889bca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.876012:0:6680:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787779656.876040:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787779656.876058:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000304b3d25/0x9e63ba8af6889bca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787779656.876061:0:10229:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1787779656.876067:0:10229:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787779656 00002000:00010000:2.0:1787779656.876072:0:10229:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787779656.876077:0:10229:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787779656 -> 1787779656 00010000:00010000:1.0:1787779656.876078:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e848f69200 already unused, calling callback (ffffffffc16b2420) 00002000:00010000:2.0:1787779656.876080:0:10229:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00010000:00010000:1.0:1787779656.876105:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000304b3d25/0x9e63ba8af6889bca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779656.876117:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000304b3d25/0x9e63ba8af6889bca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779656.876122:0:10229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e845c73c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3305:x1874622525029248:12345-0@lo:2:osp-syn-0-0.0 Request processed in 239us (365us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1787779656.876136:0:10229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00010000:1.0:1787779656.876147:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000304b3d25/0x9e63ba8af6889bca lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779656.876158:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000304b3d25/0x9e63ba8af6889bca lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779656.876181:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779656.876184:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779656.876186:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787779656.876220:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98e845c71e00/2, rc 0, transno 4294967315 00000100:00100000:1.0:1787779656.876226:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e845c71e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874622525029248:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787779656.876589:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3307:x1874622525029120:12345-0@lo:6:osp-syn-1-0.0 Request processed in 723us (932us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1787779656.876595:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:2.0:1787779656.876622:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98e848fd7840/2, rc 0, transno 4294967307 00000100:00100000:2.0:1787779656.876628:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e848fd7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622525029120:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787779656.877979:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779656.878032:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505107200 00000100:00100000:1.0:1787779656.878056:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505107200 00000100:00100000:1.0:1787779656.878102:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 56 00000100:00100000:1.0:1787779656.878112:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e848fd70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+10:2357:x1874622505107200:12345-192.168.201.9@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1787779656.911527:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e848fd70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+10:2357:x1874622505107200:12345-192.168.201.9@tcp:16:lhsmtool_posix.0 Request processed in 33407us (33542us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779656.911550:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 56 00000001:00080000:1.0:1787779656.911598:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000001:00080000:1.0:1787779656.911613:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:1.0:1787779656.913497:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779656.913781:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505107456 00000100:00100000:3.0:1787779656.913790:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505107456 00000100:00100000:3.0:1787779656.913851:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 184 00000100:00100000:3.0:1787779656.914037:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e845c70b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+18:11533:x1874622505107456:12345-192.168.201.9@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787779656.914084:0:8197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787779656.914799:0:8197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031a00/0x9e63ba8af6889bb5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaeef expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.914816:0:8197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98e87450a700) 00010000:00010000:3.0:1787779656.914827:0:8197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787779656.914865:0:8197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af6889bd1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.914878:0:8197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af6889bd1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.914887:0:8197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af6889bd1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787779656.915098:0:8197:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000048e7c7d9 reply state 00000000769abfdb transno 4294967462 ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af6889bd1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779656.915319:0:8197:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787779656.915417:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e845c70b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+19:11533:x1874622505107456:12345-192.168.201.9@tcp:36:lhsmtool_posix.0 Request processed in 1385us (1930us total) trans 4294967462 rc 0/0 00000100:00100000:3.0:1787779656.915425:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 184 00010000:00010000:3.0:1787779656.920752:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af6889bd1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.920774:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af6889bd1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.920782:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af6889bd1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.920788:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e8429d5000 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:3.0:1787779656.920794:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af6889bd1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.920802:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af6889bd1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779656.920830:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00010000:00010000:3.0:1787779656.920831:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98e87450a700) 00010000:00010000:3.0:1787779656.920835:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779656.920841:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af6889bd1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.920847:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af6889bd1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779656.920960:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505107584 00000100:00100000:2.0:1787779656.920970:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505107584 00000100:00100000:2.0:1787779656.921022:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 57 00000100:00100000:2.0:1787779656.921036:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e845d2fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+7:2359:x1874622505107584:12345-192.168.201.9@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787779656.921317:0:6682:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1787779656.921320:0:6682:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1787779656 -> 1787779655 00002000:00010000:2.0:1787779656.921323:0:6682:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787779654 00002000:00010000:2.0:1787779656.921326:0:6682:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787779656 -> 1787779655 00002000:00010000:2.0:1787779656.921329:0:6682:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1787779656.921378:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e845d2fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+8:2359:x1874622505107584:12345-192.168.201.9@tcp:2:lhsmtool_posix.0 Request processed in 347us (553us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1787779656.921384:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 57 00000100:00100000:0.0:1787779656.924161:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779656.924201:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505107840 00000100:00100000:3.0:1787779656.924211:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505107840 00000100:00100000:3.0:1787779656.924266:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 185 00000100:00100000:3.0:1787779656.924277:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87aa54780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+18:11533:x1874622505107840:12345-192.168.201.9@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787779656.924357:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af6889bd8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.924374:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030000/0x9e63ba8af6889b99 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaee1 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.924383:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af6889bd8 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.924414:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030000/0x9e63ba8af6889b99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaee1 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.924426:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030000/0x9e63ba8af6889b99 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaee1 expref: 18 pid: 5836 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779656.924439:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e848fd4780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5835:1874622525029376:192.168.201.9@tcp:104: 00000100:00100000:3.0:1787779656.924532:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e85191a180 going to sleep for 11 seconds 00000100:00100000:2.0:1787779656.926440:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e848fd4780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5835:1874622525029376:192.168.201.9@tcp:104: 00010000:00010000:2.0:1787779656.926465:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af6889bd8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779656.927388:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779656.927428:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505107968 00000100:00100000:3.0:1787779656.927436:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505107968 00010000:00010000:3.0:1787779656.927511:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030000/0x9e63ba8af6889b99 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaee1 expref: 19 pid: 5836 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779656.927551:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 68 00000100:00100000:3.0:1787779656.927560:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e847d97450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+19:2359:x1874622505107968:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787779656.927573:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787779656.927579:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030000/0x9e63ba8af6889b99 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaee1 expref: 19 pid: 5836 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.927592:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030000/0x9e63ba8af6889b99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaee1 expref: 19 pid: 5836 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.927614:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030000/0x9e63ba8af6889b99 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaee1 expref: 19 pid: 5836 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.927626:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98e87450a700) 00010000:00010000:3.0:1787779656.927631:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af6889bd8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.927640:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af6889bd8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.927647:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af6889bd8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.927676:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787779656.927746:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e847d97450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+18:2359:x1874622505107968:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 186us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779656.927754:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 68 00010000:00010000:1.0:1787779656.927775:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af6889bd8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779656.927785:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af6889bd8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779656.927817:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af6889bd8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779656.927824:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af6889bd8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779656.927830:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af6889bd8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779656.927836:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e8429d5c00 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:1.0:1787779656.927839:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af6889bd8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779656.927904:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af6889bd8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779656.927923:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98e87450a700) 00010000:00010000:1.0:1787779656.927926:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787779656.927930:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af6889bd8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779656.927936:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af6889bd8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779656.927991:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87aa54780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+17:11533:x1874622505107840:12345-192.168.201.9@tcp:55:lhsmtool_posix.0 Request processed in 3716us (3837us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787779656.928000:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 185 00000100:00100000:1.0:1787779656.944062:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779656.944580:0:10229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505108096 00000100:00100000:3.0:1787779656.944592:0:10229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505108096 00000100:00100000:3.0:1787779656.944652:0:10229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 58 00000100:00100000:3.0:1787779656.944663:0:10229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e881a6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+8:2359:x1874622505108096:12345-192.168.201.9@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787779656.944728:0:10229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000110a53d4/0x9e63ba8af6889bdf lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.944769:0:10229:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000807640ef/0x9e63ba8af6889bc3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaefd expref: 8 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.945575:0:10229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787779656.945580:0:10229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787779656.945586:0:10229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000110a53d4/0x9e63ba8af6889bdf lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.945631:0:10229:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000807640ef/0x9e63ba8af6889bc3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaefd expref: 8 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.945647:0:10229:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000807640ef/0x9e63ba8af6889bc3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaefd expref: 8 pid: 6681 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779656.945661:0:10229:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e848fd7c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10229:1874622525029504:192.168.201.9@tcp:104: 00000100:00100000:3.0:1787779656.945978:0:10229:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e85191a000 going to sleep for 11 seconds 00000100:00100000:3.0:1787779656.950783:0:10229:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e848fd7c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10229:1874622525029504:192.168.201.9@tcp:104: 00010000:00010000:3.0:1787779656.950823:0:10229:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000110a53d4/0x9e63ba8af6889bdf lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779656.952678:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779656.952809:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505108224 00000100:00100000:3.0:1787779656.952818:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505108224 00010000:00010000:3.0:1787779656.952860:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000807640ef/0x9e63ba8af6889bc3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaefd expref: 9 pid: 6681 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779656.952901:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 69 00000100:00100000:3.0:1787779656.952910:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e845c73480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+9:2359:x1874622505108224:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787779656.952929:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787779656.953078:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000807640ef/0x9e63ba8af6889bc3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaefd expref: 9 pid: 6681 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.953094:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000807640ef/0x9e63ba8af6889bc3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaefd expref: 9 pid: 6681 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.953119:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000807640ef/0x9e63ba8af6889bc3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaefd expref: 9 pid: 6681 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.953133:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787779656.953138:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787779656.953144:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000110a53d4/0x9e63ba8af6889bdf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.953154:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000110a53d4/0x9e63ba8af6889bdf lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.953193:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787779656.953258:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e845c73480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+8:2359:x1874622505108224:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 342us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779656.953267:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 69 00010000:00010000:0.0:1787779656.953334:0:10229:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000110a53d4/0x9e63ba8af6889bdf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.953344:0:10229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000110a53d4/0x9e63ba8af6889bdf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.953369:0:10229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000110a53d4/0x9e63ba8af6889bdf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.953377:0:10229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000110a53d4/0x9e63ba8af6889bdf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.953385:0:10229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000110a53d4/0x9e63ba8af6889bdf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.953394:0:10229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e8429d5000 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:0.0:1787779656.953398:0:10229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000110a53d4/0x9e63ba8af6889bdf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.953408:0:10229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000110a53d4/0x9e63ba8af6889bdf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.953422:0:10229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000110a53d4/0x9e63ba8af6889bdf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.953441:0:10229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000110a53d4/0x9e63ba8af6889bdf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779656.953489:0:10229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e881a6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+7:2359:x1874622505108096:12345-192.168.201.9@tcp:1:lhsmtool_posix.0 Request processed in 8828us (9436us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779656.953498:0:10229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 58 00000100:00100000:0.0:1787779656.956369:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779656.956444:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505108480 00000100:00100000:1.0:1787779656.956454:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505108480 00000100:00100000:1.0:1787779656.956514:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 186 00000100:00100000:1.0:1787779656.956523:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87aa552c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+17:11533:x1874622505108480:12345-192.168.201.9@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787779656.956603:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889be6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779656.956621:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889be6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779656.956633:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889be6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779656.956905:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af6889bed lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779656.956927:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031800/0x9e63ba8af6889ba7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaee8 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779656.956937:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af6889bed lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779656.956971:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031800/0x9e63ba8af6889ba7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaee8 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779656.956985:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031800/0x9e63ba8af6889ba7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaee8 expref: 18 pid: 5836 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779656.957001:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e845c71a40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5837:1874622525029632:192.168.201.9@tcp:104: 00000100:00100000:1.0:1787779656.957086:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e87a716480 going to sleep for 11 seconds 00000100:00100000:0.0:1787779656.959569:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e845c71a40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5837:1874622525029632:192.168.201.9@tcp:104: 00010000:00010000:0.0:1787779656.959597:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af6889bed lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779656.961048:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779656.961113:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505108608 00000100:00100000:3.0:1787779656.961120:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505108608 00010000:00010000:3.0:1787779656.961157:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031800/0x9e63ba8af6889ba7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaee8 expref: 19 pid: 5836 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779656.961196:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 70 00000100:00100000:3.0:1787779656.961215:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e88195da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+19:2359:x1874622505108608:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787779656.961230:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787779656.961236:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031800/0x9e63ba8af6889ba7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaee8 expref: 19 pid: 5836 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.961254:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031800/0x9e63ba8af6889ba7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaee8 expref: 19 pid: 5836 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.961277:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031800/0x9e63ba8af6889ba7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaee8 expref: 19 pid: 5836 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.961291:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98e87450a700) 00010000:00010000:3.0:1787779656.961296:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af6889bed lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.961316:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af6889bed lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.961331:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af6889bed lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.961356:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787779656.961422:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e88195da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+18:2359:x1874622505108608:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 206us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779656.961429:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 70 00010000:00010000:3.0:1787779656.961501:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af6889bed lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.961508:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af6889bed lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787779656.961691:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:3.0:1787779656.961839:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:3.0:1787779656.961876:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:3.0:1787779656.961941:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e848fd7c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5837:1874622525029760:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787779656.961982:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779656.962004:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e85191acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787779656.963062:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525029760 00000100:00100000:2.0:1787779656.963070:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525029760 00000100:00100000:2.0:1787779656.963118:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787779656.963128:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e848fd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5837:x1874622525029760:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787779656.963225:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e848fd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5837:x1874622525029760:12345-0@lo:1000:mdt00_002.0 Request processed in 98us (1241us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779656.963239:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787779656.964475:0:5837:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:3.0:1787779656.964486:0:5837:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98e845c71e00, transno 4294967315 00000100:00100000:3.0:1787779656.964509:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e848fd7c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5837:1874622525029760:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1787779656.964996:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:3.0:1787779656.965062:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e848fd7c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5837:1874622525029888:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787779656.965115:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779656.965138:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e85191a000 going to sleep for 11 seconds 00000100:00100000:3.0:1787779656.965156:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525029888 00000100:00100000:3.0:1787779656.965160:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525029888 00000100:00100000:3.0:1787779656.965193:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787779656.965198:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e848fd6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5837:x1874622525029888:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787779656.966172:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e848fd6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5837:x1874622525029888:12345-0@lo:1000:mdt00_002.0 Request processed in 969us (1052us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1787779656.966182:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787779656.966232:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e848fd7c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5837:1874622525029888:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1787779656.966339:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af6889bed lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.966350:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af6889bed lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.966358:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af6889bed lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.966364:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87a98b600 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:3.0:1787779656.966369:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af6889bed lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.966376:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af6889bed lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.966390:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98e87450a700) 00010000:00010000:3.0:1787779656.966393:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787779656.966398:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af6889bed lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.966404:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af6889bed lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.966432:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030400/0x9e63ba8af6889b22 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.966445:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030400/0x9e63ba8af6889b22 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.966451:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030400/0x9e63ba8af6889b22 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.966455:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e840030400 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:3.0:1787779656.966458:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030400/0x9e63ba8af6889b22 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.966464:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030400/0x9e63ba8af6889b22 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.966472:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e87450aa00) 00010000:00010000:3.0:1787779656.966474:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787779656.966477:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030400/0x9e63ba8af6889b22 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.966482:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030400/0x9e63ba8af6889b22 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.966502:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af6889bf4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.966515:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66a00/0x9e63ba8af6889b3e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaecc expref: 21 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.966524:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af6889bf4 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.966551:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66a00/0x9e63ba8af6889b3e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaecc expref: 21 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.966573:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66a00/0x9e63ba8af6889b3e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaecc expref: 21 pid: 5836 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779656.966586:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e848fd61c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5837:1874622525030016:192.168.201.9@tcp:104: 00000100:00100000:3.0:1787779656.966729:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e848c94900 going to sleep for 11 seconds 00000100:00100000:3.0:1787779656.969487:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e848fd61c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5837:1874622525030016:192.168.201.9@tcp:104: 00010000:00010000:3.0:1787779656.969517:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af6889bf4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779656.970835:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779656.970884:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505108736 00000100:00100000:3.0:1787779656.970891:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505108736 00010000:00010000:3.0:1787779656.970931:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66a00/0x9e63ba8af6889b3e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaecc expref: 22 pid: 5836 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779656.970973:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 71 00000100:00100000:3.0:1787779656.970983:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e851682d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+22:2360:x1874622505108736:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787779656.971000:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787779656.971007:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66a00/0x9e63ba8af6889b3e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaecc expref: 22 pid: 5836 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.971019:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66a00/0x9e63ba8af6889b3e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaecc expref: 22 pid: 5836 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.971041:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66a00/0x9e63ba8af6889b3e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaecc expref: 22 pid: 5836 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.971077:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e87450aa00) 00010000:00010000:3.0:1787779656.971083:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af6889bf4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.971092:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af6889bf4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.971101:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af6889bf4 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779656.971130:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787779656.971177:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e851682d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+21:2360:x1874622505108736:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 195us (348us total) trans 0 rc 0/0 00010000:00010000:0.0:1787779656.971182:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af6889bf4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779656.971185:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 71 00010000:00010000:0.0:1787779656.971189:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af6889bf4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.971200:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af6889bf4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.971207:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af6889bf4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.971214:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af6889bf4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.971228:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e8429d4400 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:0.0:1787779656.971231:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af6889bf4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.971236:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af6889bf4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.971242:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e87450aa00) 00010000:00010000:0.0:1787779656.971253:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787779656.971256:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af6889bf4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.971260:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af6889bf4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.971270:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889be6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.971274:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889be6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.971278:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889be6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.971281:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87a98ae00 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:0.0:1787779656.971282:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889be6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.971285:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889be6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.971296:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e87450aa00) 00010000:00010000:0.0:1787779656.971298:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787779656.971310:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889be6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.971314:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889be6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779656.971476:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87aa552c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+20:11533:x1874622505108480:12345-192.168.201.9@tcp:57:lhsmtool_posix.0 Request processed in 14954us (15116us total) trans 4294967467 rc 0/0 00000100:00100000:0.0:1787779656.971484:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 186 00000020:00080000:0.0:1787779656.971487:0:5837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787779656.971566:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787779656.971571:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787779656.972167:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:3.0:1787779656.972177:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787779656.974570:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779656.974700:0:11475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505108992 00000100:00100000:2.0:1787779656.974727:0:11475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505108992 00000100:00100000:2.0:1787779656.974790:0:11475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 50 00000100:00100000:2.0:1787779656.974801:0:11475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e86c75b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+20:11533:x1874622505108992:12345-192.168.201.9@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787779656.975535:0:11475:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787779656.975638:0:11475:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967468 00010000:00010000:2.0:1787779656.975681:0:11475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66400/0x9e63ba8af6889bfb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779656.975696:0:11475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66400/0x9e63ba8af6889bfb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 11475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779656.975707:0:11475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66400/0x9e63ba8af6889bfb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 11475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779656.975749:0:11475:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66400/0x9e63ba8af6889bfb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 11475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779656.975756:0:11475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66400/0x9e63ba8af6889bfb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 11475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779656.975761:0:11475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66400/0x9e63ba8af6889bfb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 11475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779656.975778:0:11475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787779656.975874:0:11475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e86c75b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+22:11533:x1874622505108992:12345-192.168.201.9@tcp:35:lhsmtool_posix.0 Request processed in 1073us (1310us total) trans 4294967469 rc 0/0 00000100:00100000:2.0:1787779656.975883:0:11475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 50 00000020:00080000:2.0:1787779656.975895:0:11475:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787779656.977411:0:8500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787779656.977420:0:8500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66400/0x9e63ba8af6889bfb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 11475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.977427:0:8500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87aa66400 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:0.0:1787779656.977431:0:8500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66400/0x9e63ba8af6889bfb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 11475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.977439:0:8500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66400/0x9e63ba8af6889bfb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 11475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.977453:0:8500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98e84927f000) 00010000:00010000:0.0:1787779656.977455:0:8500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787779656.977459:0:8500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66400/0x9e63ba8af6889bfb lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.977463:0:8500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66400/0x9e63ba8af6889bfb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779656.977544:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779656.977546:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779656.977547:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779657.141252:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e845c703c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874622525030144:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787779657.141348:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779657.141437:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525030144 00000100:00100000:2.0:1787779657.141444:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525030144 00000100:00100000:2.0:1787779657.141503:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787779657.141512:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87aa312c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1874622525030144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787779657.141533:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1787779657.141707:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87aa312c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1874622525030144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 195us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779657.141746:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787779657.142693:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e845c703c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874622525030144:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1787779657.308817:0:12452:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787779657.308826:0:12452:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787779657.308863:0:12452:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1787779657.308869:0:12452:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787779657.335853:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787779657.437905:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779657.437994:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505109248 00000100:00100000:3.0:1787779657.438004:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505109248 00000100:00100000:3.0:1787779657.438098:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 187 00000100:00100000:3.0:1787779657.438107:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e33c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+22:11543:x1874622505109248:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:3.0:1787779657.438130:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779657.438151:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5800/0x9e63ba8af6889c02 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedaf04 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.438434:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5400/0x9e63ba8af6889c09 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.438451:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5400/0x9e63ba8af6889c09 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.438461:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5400/0x9e63ba8af6889c09 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787779657.438472:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:3.0:1787779657.438613:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5800/0x9e63ba8af6889c02 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf04 expref: 25 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.438627:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5400/0x9e63ba8af6889c09 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf04 expref: 24 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.438635:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98e87450a100) 00010000:00010000:3.0:1787779657.438637:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787779657.438640:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e8429d5400, rc 0) 00000100:00100000:3.0:1787779657.438699:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e33c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+24:11543:x1874622505109248:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 594us (805us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1787779657.438705:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 187 00000100:00100000:1.0:1787779657.443879:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779657.444078:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505109376 00000100:00100000:3.0:1787779657.444088:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505109376 00000100:00100000:0.0:1787779657.446564:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 188 00000100:00100000:0.0:1787779657.446586:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e845c70f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+24:11543:x1874622505109376:12345-192.168.201.9@tcp:34:lfs.0 00010000:00010000:0.0:1787779657.446671:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af6889c17 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.446688:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af6889c17 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.446699:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af6889c17 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.446728:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68800/0x9e63ba8af6889c1e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.446736:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68800/0x9e63ba8af6889c1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.446743:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68800/0x9e63ba8af6889c1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.447352:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af6889c25 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.447363:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af6889c25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.447370:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af6889c25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787779657.447410:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af6889c25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.447423:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af6889c17 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.447429:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af6889c17 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.447436:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af6889c17 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.447441:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e848f68000 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:0.0:1787779657.447445:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af6889c17 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.447452:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af6889c17 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.447463:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98e87450a100) 00010000:00010000:0.0:1787779657.447466:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787779657.447471:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af6889c17 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.447483:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af6889c17 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.447493:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68800/0x9e63ba8af6889c1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.447499:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68800/0x9e63ba8af6889c1e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.447505:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68800/0x9e63ba8af6889c1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.447509:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e848f68800 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:0.0:1787779657.447512:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68800/0x9e63ba8af6889c1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.447517:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68800/0x9e63ba8af6889c1e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.447524:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98e860e78f00) 00010000:00010000:0.0:1787779657.447527:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787779657.447529:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68800/0x9e63ba8af6889c1e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.447535:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68800/0x9e63ba8af6889c1e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.447549:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af6889c25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.447555:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af6889c25 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.447565:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af6889c25 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.447570:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e848f68200 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:0.0:1787779657.447573:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af6889c25 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.447578:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af6889c25 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.447586:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e860e78200) 00010000:00010000:0.0:1787779657.447588:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787779657.447591:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af6889c25 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.447597:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af6889c25 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779657.449485:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e845c70f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+24:11543:x1874622505109376:12345-192.168.201.9@tcp:34:lfs.0 Request processed in 2899us (5604us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779657.449499:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 188 00000100:00100000:2.0:1787779657.499012:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779657.499106:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505109632 00000100:00100000:3.0:1787779657.499116:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505109632 00000100:00100000:3.0:1787779657.499172:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 189 00000100:00100000:3.0:1787779657.499181:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e30f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+24:11546:x1874622505109632:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:3.0:1787779657.499202:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779657.499222:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5800/0x9e63ba8af6889c2c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedaf0b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.499323:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af6889c33 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.499339:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af6889c33 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.499351:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af6889c33 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.499366:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af6889c3a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.499373:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af6889c3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.499379:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af6889c3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.499703:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af6889c41 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.499756:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af6889c41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.499763:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af6889c41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787779657.499773:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1787779657.499868:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af6889c33 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.499876:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af6889c33 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.499889:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af6889c33 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.499895:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e8429d4400 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:3.0:1787779657.499900:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af6889c33 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.499907:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af6889c33 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.499920:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98e87450a100) 00010000:00010000:3.0:1787779657.499923:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779657.499928:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af6889c33 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.499934:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af6889c33 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.499949:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af6889c3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.499955:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af6889c3a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.499960:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af6889c3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.499965:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e8429d5000 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:3.0:1787779657.499968:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af6889c3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.499983:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af6889c3a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.499991:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98e87450a700) 00010000:00010000:3.0:1787779657.499993:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779657.499997:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af6889c3a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.500002:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af6889c3a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.500111:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5800/0x9e63ba8af6889c2c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf0b expref: 27 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.500125:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af6889c41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf0b expref: 26 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.500132:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e87450a900) 00010000:00010000:3.0:1787779657.500135:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787779657.500137:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e8429d5c00, rc 0) 00000100:00100000:3.0:1787779657.500204:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e30f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+26:11546:x1874622505109632:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 1024us (1203us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1787779657.500213:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 189 00000100:00100000:2.0:1787779657.503386:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779657.503465:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505109760 00000100:00100000:3.0:1787779657.503474:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505109760 00000100:00100000:3.0:1787779657.503535:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 190 00000100:00100000:3.0:1787779657.503548:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e32580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+26:11546:x1874622505109760:12345-192.168.201.9@tcp:54:lfs.0 00010000:00010000:3.0:1787779657.503680:0:8197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030400/0x9e63ba8af6889c4f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.503701:0:8197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030400/0x9e63ba8af6889c4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.503864:0:8197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030400/0x9e63ba8af6889c4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.503891:0:8197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030400/0x9e63ba8af6889c4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.503897:0:8197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030400/0x9e63ba8af6889c4f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.503903:0:8197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030400/0x9e63ba8af6889c4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.503909:0:8197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e840030400 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:3.0:1787779657.503913:0:8197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030400/0x9e63ba8af6889c4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.504052:0:8197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030400/0x9e63ba8af6889c4f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.504067:0:8197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e87450a900) 00010000:00010000:3.0:1787779657.504070:0:8197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787779657.504075:0:8197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030400/0x9e63ba8af6889c4f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.504085:0:8197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030400/0x9e63ba8af6889c4f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779657.504208:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e32580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+26:11546:x1874622505109760:12345-192.168.201.9@tcp:54:lfs.0 Request processed in 664us (831us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779657.504217:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 190 00000100:00100000:0.0:1787779657.508507:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779657.508602:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505110016 00000100:00100000:1.0:1787779657.508612:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505110016 00000100:00100000:1.0:1787779657.508672:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 51 00000100:00100000:1.0:1787779657.508683:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87aa321c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+26:11546:x1874622505110016:12345-192.168.201.9@tcp:35:lfs.0 00000100:00100000:1.0:1787779657.509194:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87aa321c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+27:11546:x1874622505110016:12345-192.168.201.9@tcp:35:lfs.0 Request processed in 511us (693us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1787779657.509203:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 51 00000100:00100000:2.0:1787779657.534283:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779657.534455:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505110272 00000100:00100000:3.0:1787779657.534465:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505110272 00000100:00100000:3.0:1787779657.534518:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 191 00000100:00100000:3.0:1787779657.534527:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+27:11080:x1874622505110272:12345-192.168.201.9@tcp:101:bash.0 00010000:00010000:3.0:1787779657.534552:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779657.534572:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030400/0x9e63ba8af6889c56 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedaf12 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.534672:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031800/0x9e63ba8af6889c5d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.534687:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af6889c41 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf0b expref: 28 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.534696:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031800/0x9e63ba8af6889c5d lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.535012:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af6889c41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf0b expref: 28 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.535028:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af6889c41 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf0b expref: 28 pid: 5835 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779657.535040:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e848fd61c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5835:1874622525030272:192.168.201.9@tcp:104: 00000100:00100000:3.0:1787779657.535623:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e743665a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787779657.542276:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779657.542488:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e848fd61c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5835:1874622525030272:192.168.201.9@tcp:104: 00010000:00010000:3.0:1787779657.542515:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031800/0x9e63ba8af6889c5d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779657.542581:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505110400 00000100:00100000:1.0:1787779657.542589:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505110400 00010000:00010000:1.0:1787779657.542624:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af6889c41 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf0b expref: 29 pid: 5835 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779657.542777:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 72 00000100:00100000:1.0:1787779657.542797:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842fecf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+29:2359:x1874622505110400:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787779657.542813:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787779657.542821:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af6889c41 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf0b expref: 29 pid: 5835 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779657.542833:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af6889c41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf0b expref: 29 pid: 5835 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779657.543072:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af6889c41 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf0b expref: 29 pid: 5835 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779657.543090:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e87450a900) 00010000:00010000:1.0:1787779657.543095:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031800/0x9e63ba8af6889c5d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779657.543115:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031800/0x9e63ba8af6889c5d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779657.543124:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031800/0x9e63ba8af6889c5d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779657.543151:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787779657.543216:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842fecf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+28:2359:x1874622505110400:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 430us (951us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779657.543224:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 72 00010000:00010000:3.0:1787779657.543759:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031800/0x9e63ba8af6889c5d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.543768:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031800/0x9e63ba8af6889c5d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787779657.543798:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1787779657.543954:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030400/0x9e63ba8af6889c56 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf12 expref: 29 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.543971:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031800/0x9e63ba8af6889c5d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf12 expref: 28 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.543979:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e87450a900) 00010000:00010000:3.0:1787779657.543982:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787779657.543985:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e840031800, rc 0) 00000100:00100000:3.0:1787779657.544032:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+28:11080:x1874622505110272:12345-192.168.201.9@tcp:101:bash.0 Request processed in 9506us (9758us total) trans 4294967473 rc 0/0 00000100:00100000:3.0:1787779657.544040:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 191 00000100:00100000:2.0:1787779657.550833:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779657.551061:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505110656 00000100:00100000:0.0:1787779657.551071:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505110656 00000100:00100000:0.0:1787779657.551138:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 192 00000100:00100000:0.0:1787779657.551149:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842fecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+28:11080:x1874622505110656:12345-192.168.201.9@tcp:36:bash.0 00010000:00010000:0.0:1787779657.551440:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af6889c6b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.551474:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af6889c6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.551486:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af6889c6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787779657.551543:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000004:00010000:0.0:1787779657.551566:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000997f42e7 reply state 00000000305d6be5 transno 4294967475 ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af6889c6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779657.551575:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1787779657.551619:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000100:00100000:0.0:1787779657.551764:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842fecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+32:11080:x1874622505110656:12345-192.168.201.9@tcp:36:bash.0 Request processed in 617us (939us total) trans 4294967476 rc 0/0 00000100:00100000:0.0:1787779657.551771:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 192 00000020:00080000:0.0:1787779657.551776:0:5837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1787779657.554758:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af6889c6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.554793:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af6889c6b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.554820:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af6889c6b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.554827:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e848f68000 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:3.0:1787779657.554831:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af6889c6b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.555053:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af6889c6b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.555071:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e87450a900) 00010000:00010000:3.0:1787779657.555074:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779657.555080:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af6889c6b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.555087:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af6889c6b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779657.557699:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779657.558272:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505110784 00000100:00100000:3.0:1787779657.558281:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505110784 00000100:00100000:3.0:1787779657.558353:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 193 00000100:00100000:3.0:1787779657.558364:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842fec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+31:11080:x1874622505110784:12345-192.168.201.9@tcp:101:bash.0 00010000:00010000:3.0:1787779657.558390:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779657.558411:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030400/0x9e63ba8af6889c72 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedaf19 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.558473:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030400/0x9e63ba8af6889c72 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf19 expref: 32 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.558507:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030400/0x9e63ba8af6889c72 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf19 expref: 32 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.558528:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e87450a900) 00010000:00010000:3.0:1787779657.558532:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787779657.558535:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e840030400, rc 0) 00000100:00100000:3.0:1787779657.558604:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842fec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+32:11080:x1874622505110784:12345-192.168.201.9@tcp:101:bash.0 Request processed in 242us (915us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779657.558611:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 193 00000100:00100000:2.0:1787779657.562757:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779657.563382:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505110912 00000100:00100000:3.0:1787779657.563392:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505110912 00000100:00100000:2.0:1787779657.563596:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 59 00000100:00100000:2.0:1787779657.563607:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec18f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+7:11080:x1874622505110912:12345-192.168.201.9@tcp:101:bash.0 00010000:00010000:2.0:1787779657.563626:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779657.563645:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004a4d0f41/0x9e63ba8af6889c79 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedaf20 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787779657.563673:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a8f5a47, atime: 0x6a8f5a46, ctime: 0x6a8f5a47, blocks: 0xb 00010000:00010000:2.0:1787779657.563696:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=423s v=(0 0) 00010000:00010000:2.0:1787779657.563701:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787779657.563730:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a4d0f41/0x9e63ba8af6889c79 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf20 expref: 8 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779657.563775:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004a4d0f41/0x9e63ba8af6889c79 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf20 expref: 8 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779657.564159:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87aa67600, rc 0) 00000100:00100000:2.0:1787779657.565350:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec18f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+8:11080:x1874622505110912:12345-192.168.201.9@tcp:101:bash.0 Request processed in 1738us (2634us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779657.565360:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 59 00000100:00100000:2.0:1787779657.566023:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00080000:1.0:1787779657.566364:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787779657.566418:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505111040 00000100:00100000:3.0:1787779657.566426:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505111040 00002000:00010000:3.0:1787779657.566462:0:6685:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:3.0:1787779657.566467:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98e87ec18780 with x1874622505111040 ext(0->18446744073709551615) 00002000:00010000:3.0:1787779657.566477:0:6685:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98e87ec18780. 00000100:00100000:3.0:1787779657.566541:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 6 00000100:00100000:3.0:1787779657.566551:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec18780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+8:2359:x1874622505111040:12345-192.168.201.9@tcp:10:bash.0 00002000:00010000:3.0:1787779657.567016:0:6685:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1787779657.567020:0:6685:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1787779655 -> 1787779656 00002000:00010000:3.0:1787779657.567023:0:6685:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1787779654 -> 1787779654 00002000:00010000:3.0:1787779657.567025:0:6685:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787779655 -> 1787779656 00002000:00010000:3.0:1787779657.567027:0:6685:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1787779657.567088:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec18780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+9:2359:x1874622505111040:12345-192.168.201.9@tcp:10:bash.0 Request processed in 537us (1065us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1787779657.567429:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 6 00002000:00010000:3.0:1787779657.567434:0:6685:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:3.0:1787779657.567438:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98e87ec18780 with x1874622505111040 ext(0->18446744073709551615) 00002000:00010000:3.0:1787779657.567444:0:6685:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98e87ec18780. 00000100:00100000:3.0:1787779657.644272:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779657.644390:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505111168 00000100:00100000:0.0:1787779657.644402:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505111168 00000100:00100000:0.0:1787779657.644464:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 194 00000100:00100000:0.0:1787779657.644474:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e848fd61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+32:11560:x1874622505111168:12345-192.168.201.9@tcp:34:lfs.0 00010000:00010000:0.0:1787779657.644555:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68a00/0x9e63ba8af6889c80 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.644572:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68a00/0x9e63ba8af6889c80 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.644584:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68a00/0x9e63ba8af6889c80 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.644600:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af6889c87 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.644620:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af6889c87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.644627:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af6889c87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.644971:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af6889c8e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.644996:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af6889c8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.645003:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af6889c8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787779657.645044:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af6889c8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.645056:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68a00/0x9e63ba8af6889c80 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.645062:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68a00/0x9e63ba8af6889c80 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.645068:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68a00/0x9e63ba8af6889c80 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.645073:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e848f68a00 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:0.0:1787779657.645077:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68a00/0x9e63ba8af6889c80 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.645084:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68a00/0x9e63ba8af6889c80 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.645102:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98e87450a100) 00010000:00010000:0.0:1787779657.645105:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787779657.645110:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68a00/0x9e63ba8af6889c80 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.645117:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68a00/0x9e63ba8af6889c80 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.645130:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af6889c87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.645136:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af6889c87 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.645141:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af6889c87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.645146:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e848f69200 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:0.0:1787779657.645149:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af6889c87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.645156:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af6889c87 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.645163:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98e860e78200) 00010000:00010000:0.0:1787779657.645166:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787779657.645169:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af6889c87 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.645175:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af6889c87 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.645199:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af6889c8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.645206:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af6889c8e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.645211:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af6889c8e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.645216:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e848f68000 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:0.0:1787779657.645219:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af6889c8e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.645225:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af6889c8e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.645233:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e87450a900) 00010000:00010000:0.0:1787779657.645236:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787779657.645239:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af6889c8e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.645245:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af6889c8e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779657.645437:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e848fd61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+32:11560:x1874622505111168:12345-192.168.201.9@tcp:34:lfs.0 Request processed in 961us (1175us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779657.645445:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 194 00000100:00100000:2.0:1787779657.704004:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779657.704105:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505111424 00000100:00100000:0.0:1787779657.704116:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505111424 00000100:00100000:0.0:1787779657.704184:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 195 00000100:00100000:0.0:1787779657.704208:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec18b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+32:11563:x1874622505111424:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:0.0:1787779657.704241:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787779657.704262:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af6889c95 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedaf27 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.704345:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af6889c9c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.704359:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af6889c9c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.704371:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af6889c9c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.704387:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68a00/0x9e63ba8af6889ca3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.704395:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68a00/0x9e63ba8af6889ca3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.704401:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68a00/0x9e63ba8af6889ca3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.704691:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68800/0x9e63ba8af6889caa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.704701:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68800/0x9e63ba8af6889caa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.704708:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68800/0x9e63ba8af6889caa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787779657.704768:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787779657.704871:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af6889c9c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.704879:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af6889c9c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.704886:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af6889c9c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.704891:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e848f69200 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:0.0:1787779657.704895:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af6889c9c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.704902:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af6889c9c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.704915:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98e87450a100) 00010000:00010000:0.0:1787779657.704918:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787779657.704922:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af6889c9c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.704928:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af6889c9c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.704940:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68a00/0x9e63ba8af6889ca3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.704946:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68a00/0x9e63ba8af6889ca3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.704961:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68a00/0x9e63ba8af6889ca3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.704965:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e848f68a00 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:0.0:1787779657.704968:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68a00/0x9e63ba8af6889ca3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.704973:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68a00/0x9e63ba8af6889ca3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.704980:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98e860e78200) 00010000:00010000:0.0:1787779657.704982:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787779657.704984:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68a00/0x9e63ba8af6889ca3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.704989:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68a00/0x9e63ba8af6889ca3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.705026:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af6889c95 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf27 expref: 35 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.705040:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68800/0x9e63ba8af6889caa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf27 expref: 34 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.705047:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e87450a900) 00010000:00010000:0.0:1787779657.705049:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787779657.705051:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e848f68800, rc 0) 00000100:00100000:0.0:1787779657.705122:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec18b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+34:11563:x1874622505111424:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 916us (1129us total) trans 4294967477 rc 0/0 00000100:00100000:0.0:1787779657.705139:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 195 00000100:00100000:2.0:1787779657.712646:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779657.712742:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505111552 00000100:00100000:3.0:1787779657.712752:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505111552 00000100:00100000:3.0:1787779657.712821:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 196 00000100:00100000:3.0:1787779657.712831:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ab35680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+34:11563:x1874622505111552:12345-192.168.201.9@tcp:54:lfs.0 00010000:00010000:3.0:1787779657.712900:0:8197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030000/0x9e63ba8af6889cb8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.712927:0:8197:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031800/0x9e63ba8af6889c5d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf12 expref: 34 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.712935:0:8197:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030000/0x9e63ba8af6889cb8 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.712975:0:8197:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031800/0x9e63ba8af6889c5d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf12 expref: 34 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.712988:0:8197:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031800/0x9e63ba8af6889c5d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf12 expref: 34 pid: 5835 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779657.713004:0:8197:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e848fd4f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8197:1874622525030400:192.168.201.9@tcp:104: 00000100:00100000:3.0:1787779657.713101:0:8197:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e743665c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787779657.719277:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779657.719448:0:8197:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e848fd4f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8197:1874622525030400:192.168.201.9@tcp:104: 00010000:00010000:3.0:1787779657.719494:0:8197:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030000/0x9e63ba8af6889cb8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779657.719613:0:11475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505111808 00000100:00100000:0.0:1787779657.719621:0:11475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505111808 00000100:00100000:0.0:1787779657.719751:0:11475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 52 00000100:00100000:0.0:1787779657.719760:0:11475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ab36d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+35:5598:x1874622505111808:12345-192.168.201.9@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787779657.720080:0:11475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ab36d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+36:5598:x1874622505111808:12345-192.168.201.9@tcp:35:ldlm_bl.0 Request processed in 320us (810us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1787779657.720087:0:11475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 52 00000100:00100000:2.0:1787779657.722502:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779657.722605:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505111936 00000100:00100000:0.0:1787779657.722613:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505111936 00010000:00010000:0.0:1787779657.722650:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031800/0x9e63ba8af6889c5d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf12 expref: 36 pid: 5835 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779657.722738:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 73 00000100:00100000:0.0:1787779657.722748:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ab34f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+36:2360:x1874622505111936:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787779657.722765:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787779657.722772:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031800/0x9e63ba8af6889c5d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf12 expref: 36 pid: 5835 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.722792:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031800/0x9e63ba8af6889c5d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf12 expref: 36 pid: 5835 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.722815:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031800/0x9e63ba8af6889c5d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf12 expref: 36 pid: 5835 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.722833:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e87450a900) 00010000:00010000:0.0:1787779657.722852:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030000/0x9e63ba8af6889cb8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.722862:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030000/0x9e63ba8af6889cb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.722870:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030000/0x9e63ba8af6889cb8 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.722943:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787779657.722996:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ab34f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+35:2360:x1874622505111936:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 250us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779657.723004:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 73 00010000:00010000:2.0:1787779657.724060:0:8197:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030000/0x9e63ba8af6889cb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779657.724072:0:8197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030000/0x9e63ba8af6889cb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779657.724106:0:8197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030000/0x9e63ba8af6889cb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779657.724114:0:8197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030000/0x9e63ba8af6889cb8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779657.724120:0:8197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030000/0x9e63ba8af6889cb8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779657.724125:0:8197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e840030000 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:2.0:1787779657.724139:0:8197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030000/0x9e63ba8af6889cb8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779657.724146:0:8197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030000/0x9e63ba8af6889cb8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779657.724159:0:8197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e87450a900) 00010000:00010000:2.0:1787779657.724162:0:8197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787779657.724166:0:8197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030000/0x9e63ba8af6889cb8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779657.724308:0:8197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030000/0x9e63ba8af6889cb8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779657.724392:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ab35680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+34:11563:x1874622505111552:12345-192.168.201.9@tcp:54:lfs.0 Request processed in 11560us (11753us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779657.724403:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 196 00000100:00100000:2.0:1787779657.726584:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779657.726665:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505112192 00000100:00100000:1.0:1787779657.726674:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505112192 00000100:00100000:1.0:1787779657.726754:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 53 00000100:00100000:1.0:1787779657.726764:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ab352c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+34:11563:x1874622505112192:12345-192.168.201.9@tcp:35:lfs.0 00000100:00100000:1.0:1787779657.727005:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ab352c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+35:11563:x1874622505112192:12345-192.168.201.9@tcp:35:lfs.0 Request processed in 243us (429us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1787779657.727013:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 53 00000100:00100000:1.0:1787779657.799421:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779657.799595:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505112448 00000100:00100000:3.0:1787779657.799606:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505112448 00000100:00100000:3.0:1787779657.799763:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 197 00000100:00100000:3.0:1787779657.799775:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e845c71680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+35:11574:x1874622505112448:12345-192.168.201.9@tcp:101:cat.0 00010000:00010000:3.0:1787779657.799815:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779657.799841:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031a00/0x9e63ba8af6889cbf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedaf2e expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.799950:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030200/0x9e63ba8af6889cc6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.799969:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030200/0x9e63ba8af6889cc6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.799983:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030200/0x9e63ba8af6889cc6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.799999:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031800/0x9e63ba8af6889ccd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.800008:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031800/0x9e63ba8af6889ccd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.800015:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031800/0x9e63ba8af6889ccd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.800438:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030000/0x9e63ba8af6889cd4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.800454:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030000/0x9e63ba8af6889cd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.800460:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030000/0x9e63ba8af6889cd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787779657.800467:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:3.0:1787779657.800560:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030200/0x9e63ba8af6889cc6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.800567:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030200/0x9e63ba8af6889cc6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.800575:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030200/0x9e63ba8af6889cc6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.800581:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e840030200 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:3.0:1787779657.800584:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030200/0x9e63ba8af6889cc6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.800590:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030200/0x9e63ba8af6889cc6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.800600:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98e87450a100) 00010000:00010000:3.0:1787779657.800602:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779657.800605:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030200/0x9e63ba8af6889cc6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.800611:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030200/0x9e63ba8af6889cc6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.800624:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031800/0x9e63ba8af6889ccd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.800638:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031800/0x9e63ba8af6889ccd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.800644:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031800/0x9e63ba8af6889ccd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.800650:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e840031800 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:3.0:1787779657.800653:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031800/0x9e63ba8af6889ccd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.800659:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031800/0x9e63ba8af6889ccd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.800667:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98e87450a700) 00010000:00010000:3.0:1787779657.800669:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779657.800672:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031800/0x9e63ba8af6889ccd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.800678:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031800/0x9e63ba8af6889ccd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.800764:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031a00/0x9e63ba8af6889cbf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf2e expref: 38 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.800777:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030000/0x9e63ba8af6889cd4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf2e expref: 37 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.800785:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e87450a900) 00010000:00010000:3.0:1787779657.800787:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787779657.800796:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e840030000, rc 0) 00000100:00100000:3.0:1787779657.800866:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e845c71680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+37:11574:x1874622505112448:12345-192.168.201.9@tcp:101:cat.0 Request processed in 1093us (1457us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1787779657.800875:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 197 00000100:00100000:2.0:1787779657.805931:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779657.806092:0:11475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505112704 00000100:00100000:0.0:1787779657.806109:0:11475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505112704 00000100:00100000:0.0:1787779657.806219:0:11475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 54 00000100:00100000:0.0:1787779657.806239:0:11475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e855a63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+37:11574:x1874622505112704:12345-192.168.201.9@tcp:35:cat.0 00000100:00100000:0.0:1787779657.806508:0:11475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e855a63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+38:11574:x1874622505112704:12345-192.168.201.9@tcp:35:cat.0 Request processed in 279us (585us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1787779657.806517:0:11475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 54 00000100:00100000:1.0:1787779657.831895:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779657.832413:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505112960 00000100:00100000:0.0:1787779657.832423:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505112960 00000100:00100000:0.0:1787779657.832533:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 198 00000100:00100000:0.0:1787779657.832544:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e845c712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+38:11575:x1874622505112960:12345-192.168.201.9@tcp:36:rm.0 00010000:00010000:0.0:1787779657.832607:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787779657.832634:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030000/0x9e63ba8af6889cd4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf2e expref: 38 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.832676:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68800/0x9e63ba8af6889caa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf27 expref: 37 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.832689:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030400/0x9e63ba8af6889c72 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf19 expref: 36 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.832698:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e87450a900) 00010000:00010000:0.0:1787779657.832708:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787779657.832772:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af6889ce2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.832799:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af6889ce2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.832808:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af6889ce2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.832822:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68a00/0x9e63ba8af6889ce9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.832830:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68a00/0x9e63ba8af6889ce9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.832836:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68a00/0x9e63ba8af6889ce9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.833399:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af6889cf0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.833409:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af6889cf0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.833423:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af6889cf0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787779657.834548:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:0.0:1787779657.834560:0:5837:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 423575847440ns, next at 424575844968ns, rc = 0 00010000:00010000:0.0:1787779657.834625:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af6889cf7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.834638:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af6889cf7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.834646:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af6889cf7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.834653:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af6889cf7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.834659:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af6889cf7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.834665:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af6889cf7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.834681:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787779657.834706:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af6889cf0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.834763:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af6889cf0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.834769:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af6889cf0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779657.835262:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787779657.835270:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af6889cf7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779657.835278:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e848f68200 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:1.0:1787779657.835282:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af6889cf7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779657.835300:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af6889cf7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779657.835314:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e860e78f00) 00010000:00010000:1.0:1787779657.835317:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787779657.835321:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af6889cf7 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779657.835327:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af6889cf7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779657.835340:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779657.835342:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779657.835349:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779657.835429:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e848f69200 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:0.0:1787779657.835433:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af6889cf0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.835440:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af6889cf0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.835449:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e860e78f00) 00010000:00010000:0.0:1787779657.835451:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787779657.835454:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af6889cf0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.835460:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af6889cf0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.835482:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af6889ce2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.835488:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af6889ce2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.835494:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af6889ce2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.835499:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e848f68000 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:0.0:1787779657.835502:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af6889ce2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.835507:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af6889ce2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.835524:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98e87450a100) 00010000:00010000:0.0:1787779657.835526:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787779657.835529:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af6889ce2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.835535:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af6889ce2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787779657.835544:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000073efe5ce reply state 000000000d8d1607 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68a00/0x9e63ba8af6889ce9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779657.835553:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787779657.835656:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e845c712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+37:11575:x1874622505112960:12345-192.168.201.9@tcp:36:rm.0 Request processed in 3110us (3951us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1787779657.835666:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 198 00010000:00010000:3.0:1787779657.846492:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68a00/0x9e63ba8af6889ce9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.846516:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68a00/0x9e63ba8af6889ce9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.846525:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68a00/0x9e63ba8af6889ce9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.846532:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e848f68a00 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:3.0:1787779657.846537:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68a00/0x9e63ba8af6889ce9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.846546:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68a00/0x9e63ba8af6889ce9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.846566:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98e860e78200) 00010000:00010000:3.0:1787779657.846570:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779657.846576:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68a00/0x9e63ba8af6889ce9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.846582:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68a00/0x9e63ba8af6889ce9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779657.889518:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779657.889635:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505113216 00000100:00100000:0.0:1787779657.889645:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505113216 00000100:00100000:0.0:1787779657.889760:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 199 00000100:00100000:0.0:1787779657.889770:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e845c72940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+36:11581:x1874622505113216:12345-192.168.201.9@tcp:101:bash.0 00010000:00010000:0.0:1787779657.889803:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787779657.889825:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af6889cfe lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedaf35 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.889984:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af6889d05 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.890000:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af6889d05 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.890027:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af6889d05 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.890042:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68800/0x9e63ba8af6889d0c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.890048:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68800/0x9e63ba8af6889d0c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.890053:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68800/0x9e63ba8af6889d0c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787779657.891299:0:5836:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:2.0:1787779657.891480:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66600/0x9e63ba8af6889d13 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779657.891494:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66600/0x9e63ba8af6889d13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779657.891503:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66600/0x9e63ba8af6889d13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779657.891539:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af6889d05 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779657.891557:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af6889d05 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779657.891564:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af6889d05 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779657.891570:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e848f69200 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:2.0:1787779657.891575:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af6889d05 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779657.891583:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af6889d05 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779657.891595:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98e87450a100) 00010000:00010000:2.0:1787779657.891598:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787779657.891603:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af6889d05 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779657.891609:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af6889d05 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787779657.891622:0:5836:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000baebd105 reply state 000000008596dc6f transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68800/0x9e63ba8af6889d0c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779657.891631:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787779657.891665:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af6889cfe lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf35 expref: 39 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779657.891680:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66600/0x9e63ba8af6889d13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf35 expref: 38 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779657.891699:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98e84927fa00) 00010000:00010000:2.0:1787779657.891702:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787779657.891704:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87aa66600, rc 0) 00000100:00100000:2.0:1787779657.892230:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e845c72940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+39:11581:x1874622505113216:12345-192.168.201.9@tcp:101:bash.0 Request processed in 2398us (2659us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1787779657.892240:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 199 00000100:00100000:2.0:1787779657.895656:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779657.895841:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505113344 00000100:00100000:1.0:1787779657.895852:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505113344 00000100:00100000:1.0:1787779657.895936:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 60 00000100:00100000:1.0:1787779657.895947:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e855a603c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+7:2360:x1874622505113344:12345-192.168.201.9@tcp:101:bash.0 00010000:00010000:1.0:1787779657.895972:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779657.895998:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c48a6216/0x9e63ba8af6889d21 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedaf3c expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787779657.896029:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787779657.896051:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=423s v=(0 0) 00010000:00010000:1.0:1787779657.896057:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787779657.896067:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c48a6216/0x9e63ba8af6889d21 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf3c expref: 8 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779657.896089:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c48a6216/0x9e63ba8af6889d21 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf3c expref: 8 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779657.896115:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87a98a600, rc 0) 00000100:00100000:1.0:1787779657.896182:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e855a603c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+8:2360:x1874622505113344:12345-192.168.201.9@tcp:101:bash.0 Request processed in 237us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779657.896189:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 60 00000100:00080000:2.0:1787779657.897749:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787779657.897915:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68800/0x9e63ba8af6889d0c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.897932:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68800/0x9e63ba8af6889d0c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.897962:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68800/0x9e63ba8af6889d0c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.897969:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e848f68800 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:3.0:1787779657.897977:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68800/0x9e63ba8af6889d0c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.897986:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68800/0x9e63ba8af6889d0c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.898004:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98e860e78f00) 00010000:00010000:3.0:1787779657.898007:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779657.898012:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68800/0x9e63ba8af6889d0c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.898017:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68800/0x9e63ba8af6889d0c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779657.900560:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779657.900653:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505113472 00000100:00100000:3.0:1787779657.900667:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505113472 00000100:00100000:3.0:1787779657.900753:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 61 00000100:00100000:3.0:1787779657.900762:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e845c73840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+8:11581:x1874622505113472:12345-192.168.201.9@tcp:101:bash.0 00010000:00010000:3.0:1787779657.900784:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779657.900806:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043b25105/0x9e63ba8af6889d28 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedaf43 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.900839:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c48a6216/0x9e63ba8af6889d21 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf3c expref: 9 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.900865:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787779657.900870:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787779657.900876:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043b25105/0x9e63ba8af6889d28 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf43 expref: 9 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.900920:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c48a6216/0x9e63ba8af6889d21 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf3c expref: 9 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.900934:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c48a6216/0x9e63ba8af6889d21 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf3c expref: 9 pid: 6681 timeout: 523 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779657.900951:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e848fd4f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1874622525030528:192.168.201.9@tcp:104: 00000100:00100000:3.0:1787779657.901065:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e743665c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787779657.904072:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e848fd4f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1874622525030528:192.168.201.9@tcp:104: 00010000:00010000:3.0:1787779657.904117:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000043b25105/0x9e63ba8af6889d28 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf43 expref: 9 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779657.904137:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e840031a00, rc 0) 00000100:00100000:3.0:1787779657.904191:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e845c73840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+9:11581:x1874622505113472:12345-192.168.201.9@tcp:101:bash.0 Request processed in 3430us (3645us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779657.904200:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 61 00000100:00100000:1.0:1787779657.907274:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779657.907674:0:11162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505113600 00000100:00100000:0.0:1787779657.907685:0:11162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505113600 00010000:00010000:0.0:1787779657.907763:0:11162:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c48a6216/0x9e63ba8af6889d21 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf3c expref: 9 pid: 6681 timeout: 523 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779657.907797:0:11162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 74 00000100:00100000:0.0:1787779657.907807:0:11162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e845c730c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+9:2359:x1874622505113600:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787779657.907822:0:11162:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787779657.907845:0:11162:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c48a6216/0x9e63ba8af6889d21 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf3c expref: 9 pid: 6681 timeout: 523 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.907858:0:11162:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c48a6216/0x9e63ba8af6889d21 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf3c expref: 9 pid: 6681 timeout: 523 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.907884:0:11162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c48a6216/0x9e63ba8af6889d21 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf3c expref: 9 pid: 6681 timeout: 523 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.907929:0:11162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787779657.907934:0:11162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787779657.907943:0:11162:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000043b25105/0x9e63ba8af6889d28 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf43 expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.907954:0:11162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043b25105/0x9e63ba8af6889d28 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf43 expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779657.907997:0:11162:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000043b25105/0x9e63ba8af6889d28 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf43 expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779657.908012:0:11162:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e874223840 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11162:1874622525030656:192.168.201.9@tcp:105: 00000100:00100000:0.0:1787779657.908113:0:11162:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e845d95840 going to sleep for 11 seconds 00000100:00100000:1.0:1787779657.911959:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779657.912056:0:11162:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e874223840 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11162:1874622525030656:192.168.201.9@tcp:105: 00010000:00010000:0.0:1787779657.912080:0:11162:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787779657.912143:0:11162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e845c730c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+8:2359:x1874622505113600:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 4337us (4879us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779657.912155:0:11162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 74 00000100:00100000:3.0:1787779657.912382:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505113856 00000100:00100000:3.0:1787779657.912389:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505113856 00000100:00100000:3.0:1787779657.912447:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 55 00000100:00100000:3.0:1787779657.912468:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e845c70780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+38:11581:x1874622505113856:12345-192.168.201.9@tcp:35:bash.0 00000100:00100000:3.0:1787779657.912820:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e845c70780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+39:11581:x1874622505113856:12345-192.168.201.9@tcp:35:bash.0 Request processed in 352us (873us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1787779657.912828:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 55 00000100:00100000:2.0:1787779658.095513:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779658.095770:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505113984 00000100:00100000:3.0:1787779658.095793:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505113984 00000100:00100000:3.0:1787779658.095873:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 200 00000100:00100000:3.0:1787779658.095885:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e852113480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+39:11597:x1874622505113984:12345-192.168.201.9@tcp:101:lfs.0 00000100:00080000:2.0:1787779658.096008:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787779658.096350:0:8197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779658.096374:0:8197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031800/0x9e63ba8af6889d2f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedaf4a expref: -99 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779658.096441:0:8197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030200/0x9e63ba8af6889d36 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779658.096454:0:8197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030200/0x9e63ba8af6889d36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779658.096466:0:8197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030200/0x9e63ba8af6889d36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787779658.096533:0:8197:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1787779658.096537:0:8197:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787779658.096561:0:8197:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030200/0x9e63ba8af6889d36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779658.096589:0:8197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031800/0x9e63ba8af6889d2f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf4a expref: 41 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779658.096632:0:8197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030200/0x9e63ba8af6889d36 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf4a expref: 40 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779658.096641:0:8197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98e87450a100) 00010000:00010000:3.0:1787779658.096644:0:8197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787779658.096648:0:8197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e840030200, rc 0) 00000100:00100000:3.0:1787779658.096780:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e852113480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+40:11597:x1874622505113984:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 891us (1271us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779658.097657:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 200 00000100:00100000:1.0:1787779658.104521:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779658.104622:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505114240 00000100:00100000:3.0:1787779658.104633:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505114240 00000100:00100000:3.0:1787779658.104689:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 201 00000100:00100000:3.0:1787779658.104699:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e845c721c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+40:11597:x1874622505114240:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:3.0:1787779658.104760:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779658.104795:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031800/0x9e63ba8af6889d3d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedaf51 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779658.105294:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030400/0x9e63ba8af6889d44 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779658.105309:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030400/0x9e63ba8af6889d44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779658.105320:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030400/0x9e63ba8af6889d44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787779658.105332:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1787779658.105473:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e840031800/0x9e63ba8af6889d3d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf51 expref: 43 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779658.105492:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030400/0x9e63ba8af6889d44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf51 expref: 42 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779658.105499:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98e84927fa00) 00010000:00010000:3.0:1787779658.105502:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787779658.105506:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e840030400, rc 0) 00000100:00100000:3.0:1787779658.105615:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e845c721c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+42:11597:x1874622505114240:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 917us (1106us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1787779658.105623:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 201 00000100:00100000:1.0:1787779658.111575:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779658.111632:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779658.111709:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505114496 00000100:00100000:3.0:1787779658.111746:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505114496 00000100:00100000:3.0:1787779658.112026:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 202 00000100:00100000:3.0:1787779658.112107:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e845c703c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+42:11597:x1874622505114496:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:3.0:1787779658.112135:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779658.112156:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030000/0x9e63ba8af6889d52 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedaf58 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779658.112406:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af6889d59 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779658.112422:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af6889d59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779658.112434:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af6889d59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787779658.112458:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1787779658.112580:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030000/0x9e63ba8af6889d52 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf58 expref: 45 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779658.112600:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af6889d59 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf58 expref: 44 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779658.112609:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98e84927fa00) 00010000:00010000:3.0:1787779658.112612:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787779658.112615:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e8429d5c00, rc 0) 00000100:00100000:3.0:1787779658.112679:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e845c703c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+44:11597:x1874622505114496:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 644us (1115us total) trans 4294967486 rc 0/0 00000100:00100000:3.0:1787779658.112687:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 202 00000100:00100000:2.0:1787779658.113136:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505114624 00000100:00100000:2.0:1787779658.113143:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505114624 00000100:00100000:2.0:1787779658.113325:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 15 00000100:00100000:2.0:1787779658.113334:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e847d96050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+44:2359:x1874622505114624:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787779658.113345:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787779658.113363:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030400/0x9e63ba8af6889d44 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf51 expref: 44 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779658.113377:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98e84927fa00) 00010000:00010000:2.0:1787779658.113382:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787779658.113409:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e847d96050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+43:2359:x1874622505114624:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 77us (1776us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779658.113415:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 15 00000100:00100000:2.0:1787779658.122828:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779658.123438:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505114752 00000100:00100000:1.0:1787779658.123449:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505114752 00000100:00100000:1.0:1787779658.123516:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 62 00000100:00100000:1.0:1787779658.123526:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e88195da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+8:2357:x1874622505114752:12345-192.168.201.9@tcp:1:lfs.0 00010000:00010000:1.0:1787779658.123567:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4063e8c/0x9e63ba8af6889d67 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.123586:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000043b25105/0x9e63ba8af6889d28 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf43 expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.123595:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787779658.123599:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787779658.123603:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4063e8c/0x9e63ba8af6889d67 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.123640:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000043b25105/0x9e63ba8af6889d28 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf43 expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.123653:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000043b25105/0x9e63ba8af6889d28 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf43 expref: 8 pid: 6682 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779658.123666:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e845c71e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1874622525030784:192.168.201.9@tcp:104: 00000100:00100000:1.0:1787779658.123792:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e87a7166c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787779658.127676:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779658.127768:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505114880 00000100:00100000:0.0:1787779658.127784:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505114880 00002000:00100000:0.0:1787779658.127836:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff98e848fd4f00 x1874622505114880/t0(0) o4->e225400f-8d32-48a8-ab5e-fe4d3780a20c@192.168.201.9@tcp:69/0 lens 504/0 e 0 to 0 dl 1787779669 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787779658.127847:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98e848fd4f00 with x1874622505114880 ext(0->8) 00010000:00010000:0.0:1787779658.127856:0:6686:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000043b25105/0x9e63ba8af6889d28 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf43 expref: 9 pid: 6682 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779658.127888:0:6686:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000043b25105/0x9e63ba8af6889d28 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf43 expref: 9 pid: 6682 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787779658.127906:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff98e848fd4f00 00000100:00100000:0.0:1787779658.127943:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 2 00000100:00100000:0.0:1787779658.127952:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e848fd4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+9:2360:x1874622505114880:12345-192.168.201.9@tcp:4:lfs.0 00000100:00100000:0.0:1787779658.128451:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e848fd4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+11:2360:x1874622505114880:12345-192.168.201.9@tcp:4:lfs.0 Request processed in 499us (784us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1787779658.128459:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 2 00002000:00100000:0.0:1787779658.128467:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff98e848fd4f00 x1874622505114880/t4294967308(0) o4->e225400f-8d32-48a8-ab5e-fe4d3780a20c@192.168.201.9@tcp:69/0 lens 504/448 e 0 to 0 dl 1787779669 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787779658.128475:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98e848fd4f00 with x1874622505114880 ext(0->8) 00010000:00010000:0.0:1787779658.128481:0:6686:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000043b25105/0x9e63ba8af6889d28 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf43 expref: 11 pid: 6682 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779658.128493:0:6686:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000043b25105/0x9e63ba8af6889d28 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf43 expref: 11 pid: 6682 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787779658.128500:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff98e848fd4f00 00000100:00100000:1.0:1787779658.129934:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e845c71e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1874622525030784:192.168.201.9@tcp:104: 00010000:00010000:1.0:1787779658.129974:0:6681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b4063e8c/0x9e63ba8af6889d67 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779658.132141:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779658.132388:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505115008 00000100:00100000:1.0:1787779658.132398:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505115008 00010000:00010000:1.0:1787779658.132438:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000043b25105/0x9e63ba8af6889d28 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf43 expref: 11 pid: 6682 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779658.132479:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 75 00000100:00100000:1.0:1787779658.132489:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e851682d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+11:2360:x1874622505115008:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787779658.132504:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787779658.132525:0:5821:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787779658.132528:0:5821:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787779657 00002000:00010000:1.0:1787779658.132529:0:5821:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787779657 00002000:00010000:1.0:1787779658.132531:0:5821:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1787779657 00010000:00010000:1.0:1787779658.132536:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000043b25105/0x9e63ba8af6889d28 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf43 expref: 11 pid: 6682 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.132549:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000043b25105/0x9e63ba8af6889d28 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf43 expref: 11 pid: 6682 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.132571:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043b25105/0x9e63ba8af6889d28 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf43 expref: 11 pid: 6682 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.132589:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787779658.132594:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787779658.132607:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b4063e8c/0x9e63ba8af6889d67 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.132616:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4063e8c/0x9e63ba8af6889d67 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.132650:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787779658.132704:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e851682d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+10:2360:x1874622505115008:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 216us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779658.132753:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 75 00010000:00010000:2.0:1787779658.133658:0:6681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b4063e8c/0x9e63ba8af6889d67 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779658.133671:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4063e8c/0x9e63ba8af6889d67 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779658.133700:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4063e8c/0x9e63ba8af6889d67 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779658.133708:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4063e8c/0x9e63ba8af6889d67 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779658.133754:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4063e8c/0x9e63ba8af6889d67 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779658.133763:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87a98bc00 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:2.0:1787779658.133767:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4063e8c/0x9e63ba8af6889d67 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779658.133782:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4063e8c/0x9e63ba8af6889d67 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779658.133803:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4063e8c/0x9e63ba8af6889d67 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779658.133811:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4063e8c/0x9e63ba8af6889d67 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779658.133908:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e88195da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+9:2357:x1874622505114752:12345-192.168.201.9@tcp:1:lfs.0 Request processed in 10373us (11080us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779658.133917:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 62 00000100:00100000:2.0:1787779658.138006:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779658.138178:0:11475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505115264 00000100:00100000:0.0:1787779658.138189:0:11475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505115264 00000100:00100000:0.0:1787779658.138254:0:11475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 56 00000100:00100000:0.0:1787779658.138266:0:11475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e86c75a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+43:11597:x1874622505115264:12345-192.168.201.9@tcp:35:lfs.0 00000004:00010000:0.0:1787779658.138359:0:11475:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af6889d59 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf58 expref: 43 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787779658.138573:0:11475:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:0.0:1787779658.138609:0:11475:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:0.0:1787779658.140535:0:11475:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00010000:00010000:0.0:1787779658.140603:0:11475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af6889d6e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779658.140621:0:11475:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66600/0x9e63ba8af6889d13 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf35 expref: 47 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779658.140631:0:11475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af6889d6e lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779658.140670:0:11475:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66600/0x9e63ba8af6889d13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf35 expref: 47 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779658.140685:0:11475:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66600/0x9e63ba8af6889d13 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf35 expref: 47 pid: 5836 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779658.140698:0:11475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e874223840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:11475:1874622525030912:192.168.201.9@tcp:104: 00000100:00100000:0.0:1787779658.141186:0:11475:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e845d95840 going to sleep for 11 seconds 00000100:00100000:2.0:1787779658.145634:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779658.145953:0:11475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e874223840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:11475:1874622525030912:192.168.201.9@tcp:104: 00010000:00010000:0.0:1787779658.145978:0:11475:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af6889d6e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11475 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779658.146672:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505115392 00000100:00100000:3.0:1787779658.146681:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505115392 00010000:00010000:3.0:1787779658.146730:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66600/0x9e63ba8af6889d13 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf35 expref: 48 pid: 5836 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779658.146931:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 76 00000100:00100000:3.0:1787779658.146942:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842fecf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+48:2359:x1874622505115392:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787779658.146958:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787779658.146966:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66600/0x9e63ba8af6889d13 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf35 expref: 48 pid: 5836 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779658.146979:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66600/0x9e63ba8af6889d13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf35 expref: 48 pid: 5836 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779658.147016:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66600/0x9e63ba8af6889d13 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf35 expref: 48 pid: 5836 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779658.147030:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98e84927fa00) 00010000:00010000:3.0:1787779658.147138:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af6889d6e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779658.147148:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af6889d6e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779658.147155:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af6889d6e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779658.147371:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787779658.147437:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842fecf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+47:2359:x1874622505115392:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 497us (1814us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779658.147446:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 76 00010000:00010000:0.0:1787779658.150304:0:11475:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af6889d6e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779658.150342:0:11475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af6889d6e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11475 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787779658.150481:0:11475:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:0.0:1787779658.151148:0:11475:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:0.0:1787779658.151392:0:11475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e874223840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:11475:1874622525031040:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1787779658.151459:0:11475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779658.151535:0:11475:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e860d99c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787779658.151580:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525031040 00000100:00100000:3.0:1787779658.151587:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525031040 00000100:00100000:3.0:1787779658.151704:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787779658.151743:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e874220780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:11475:x1874622525031040:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1787779658.151844:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e874220780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:11475:x1874622525031040:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 133us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779658.151851:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787779658.152104:0:11475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e874223840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:11475:1874622525031040:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:1.0:1787779658.152891:0:11475:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:1.0:1787779658.153021:0:11475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e845c71e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:11475:1874622525031168:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1787779658.153313:0:11475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779658.153337:0:11475:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e87a716240 going to sleep for 11 seconds 00000100:00100000:3.0:1787779658.153581:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525031168 00000100:00100000:3.0:1787779658.153587:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525031168 00000100:00100000:3.0:1787779658.153628:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787779658.153637:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e845c71a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:11475:x1874622525031168:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1787779658.153857:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e845c71a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:11475:x1874622525031168:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 221us (543us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1787779658.153865:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787779658.154203:0:11475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e845c71e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:11475:1874622525031168:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:1.0:1787779658.154366:0:11475:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:1.0:1787779658.154405:0:11475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af6889d6e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.154414:0:11475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af6889d6e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.154422:0:11475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af6889d6e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.154428:0:11475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e848f69600 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:1.0:1787779658.154433:0:11475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af6889d6e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.154448:0:11475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af6889d6e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.154463:0:11475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98e84927fa00) 00010000:00010000:1.0:1787779658.154466:0:11475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787779658.154471:0:11475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af6889d6e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.154478:0:11475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af6889d6e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11475 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787779658.154652:0:11475:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787779658.155097:0:11475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:1.0:1787779658.155112:0:11475:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 423896398896ns, next at 424896396174ns, rc = 0 00000001:00080000:1.0:1787779658.155118:0:11475:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:1.0:1787779658.155154:0:11475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98e84927fa00) 00010000:00010000:1.0:1787779658.155157:0:11475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787779658.155292:0:11475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5c00/0x9e63ba8af6889d59 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf58 expref: 51 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779658.155419:0:11475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e86c75a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+50:11597:x1874622505115264:12345-192.168.201.9@tcp:35:lfs.0 Request processed in 17155us (17421us total) trans 4294967495 rc 0/0 00000100:00100000:1.0:1787779658.155429:0:11475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 56 00000020:00080000:1.0:1787779658.155433:0:11475:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1787779658.157790:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779658.157875:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505115520 00000100:00100000:1.0:1787779658.157885:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505115520 00000100:00100000:1.0:1787779658.157945:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 203 00000100:00100000:1.0:1787779658.157954:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e848fd70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+50:11597:x1874622505115520:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:1.0:1787779658.157997:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779658.158020:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af6889d75 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedaf5f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.158091:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af6889d75 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf5f expref: 51 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.158107:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af6889d75 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf5f expref: 51 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.158125:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98e860c40700) 00010000:00010000:1.0:1787779658.158128:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787779658.158132:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87a98a600, rc 0) 00000100:00080000:2.0:1787779658.158317:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787779658.158908:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e848fd70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+51:11597:x1874622505115520:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 952us (1131us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779658.158917:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 203 00000100:00100000:3.0:1787779658.163652:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779658.163805:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505115776 00000100:00100000:1.0:1787779658.163815:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505115776 00000100:00100000:1.0:1787779658.163867:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 57 00000100:00100000:1.0:1787779658.163877:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e848fd4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+51:11597:x1874622505115776:12345-192.168.201.9@tcp:35:lfs.0 00000100:00100000:2.0:1787779658.164411:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ab36d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c28aae66-2825-42c5-8f52-61f687e868c9:3306:1874622525031296:0@lo:400:kworker.0 00000100:00100000:2.0:1787779658.164463:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779658.164494:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e881d81a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1874622525031808:0@lo:400:kworker.0 00000100:00100000:2.0:1787779658.164517:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779658.164538:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787779658.164542:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ab352c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874622525031424:0@lo:400:kworker.0 00000100:00100000:2.0:1787779658.164559:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779658.164583:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ab34f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874622525031552:0@lo:400:kworker.0 00000100:00100000:2.0:1787779658.164605:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779658.164622:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787779658.164627:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f61da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874622525031680:0@lo:400:kworker.0 00000100:00100000:2.0:1787779658.164649:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779658.164676:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525031680 00000100:00100000:2.0:1787779658.164680:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525031680 00000100:00100000:2.0:1787779658.164736:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787779658.164743:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a963480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1874622525031680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779658.164803:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a963480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1874622525031680:12345-0@lo:400:kworker.0 Request processed in 60us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779658.164826:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787779658.164864:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f61da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874622525031680:0@lo:400:kworker.0 00000100:00080000:2.0:1787779658.164883:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787779658.165021:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525031808 00000100:00100000:2.0:1787779658.165025:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525031808 00000100:00080000:2.0:1787779658.165095:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787779658.165115:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525031424 00000100:00100000:2.0:1787779658.165118:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525031424 00000100:00100000:2.0:1787779658.165127:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525031552 00000100:00100000:2.0:1787779658.165129:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525031552 00000100:00080000:2.0:1787779658.165137:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787779658.165147:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1787779658.165153:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e881d80f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874622525031808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779658.165307:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e881d80f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874622525031808:12345-0@lo:400:kworker.0 Request processed in 153us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779658.165314:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1787779658.165335:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e881d81a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1874622525031808:0@lo:400:kworker.0 00000100:00100000:2.0:1787779658.165350:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1787779658.165355:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e881d82940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874622525031424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779658.165382:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e881d82940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874622525031424:12345-0@lo:400:kworker.0 Request processed in 27us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779658.165388:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1787779658.165404:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ab352c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874622525031424:0@lo:400:kworker.0 00000100:00100000:1.0:1787779658.165633:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e848fd4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+52:11597:x1874622505115776:12345-192.168.201.9@tcp:35:lfs.0 Request processed in 1756us (1990us total) trans 4294967496 rc 0/0 00000100:00100000:1.0:1787779658.165641:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 57 00000100:00100000:1.0:1787779658.165664:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1787779658.165671:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a960000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874622525031552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779658.165705:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a960000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874622525031552:12345-0@lo:400:kworker.0 Request processed in 35us (1098us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779658.165732:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1787779658.165758:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ab34f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874622525031552:0@lo:400:kworker.0 00000100:00100000:0.0:1787779658.166159:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525031296 00000100:00100000:0.0:1787779658.166172:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525031296 00000100:00100000:0.0:1787779658.166200:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1787779658.166207:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ebc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+19:3306:x1874622525031296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779658.166252:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ebc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+19:3306:x1874622525031296:12345-0@lo:400:kworker.0 Request processed in 46us (1788us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779658.166259:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1787779658.166307:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ab36d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c28aae66-2825-42c5-8f52-61f687e868c9:3306:1874622525031296:0@lo:400:kworker.0 00000001:00080000:0.0:1787779658.247180:0:7634:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:0.0:1787779658.247206:0:7634:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:0.0:1787779658.247510:0:7634:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:0.0:1787779658.302275:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779658.302475:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505115904 00000100:00100000:1.0:1787779658.302485:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505115904 00000100:00100000:1.0:1787779658.302546:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 204 00000100:00100000:1.0:1787779658.302556:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e874223840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+52:11607:x1874622505115904:12345-192.168.201.9@tcp:34:lfs.0 00010000:00010000:1.0:1787779658.302636:0:8197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889d7c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.302654:0:8197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889d7c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.302668:0:8197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889d7c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.302683:0:8197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af6889d83 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.302691:0:8197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af6889d83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.302697:0:8197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af6889d83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.302848:0:8197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98be00/0x9e63ba8af6889d8a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.302857:0:8197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98be00/0x9e63ba8af6889d8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.302883:0:8197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98be00/0x9e63ba8af6889d8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787779658.303045:0:8197:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98be00/0x9e63ba8af6889d8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.303059:0:8197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889d7c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.303067:0:8197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889d7c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.303074:0:8197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889d7c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.303081:0:8197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87a98ae00 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:1.0:1787779658.303087:0:8197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889d7c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.303096:0:8197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889d7c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.303110:0:8197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98e87450a100) 00010000:00010000:1.0:1787779658.303114:0:8197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787779658.303118:0:8197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889d7c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.303125:0:8197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889d7c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.303137:0:8197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af6889d83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.303147:0:8197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af6889d83 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.303153:0:8197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af6889d83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.303158:0:8197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87a98a400 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:1.0:1787779658.303161:0:8197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af6889d83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.303167:0:8197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af6889d83 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.303176:0:8197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98e860c40300) 00010000:00010000:1.0:1787779658.303178:0:8197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787779658.303181:0:8197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af6889d83 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.303186:0:8197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af6889d83 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.303202:0:8197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98be00/0x9e63ba8af6889d8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.303209:0:8197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98be00/0x9e63ba8af6889d8a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.303215:0:8197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98be00/0x9e63ba8af6889d8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.303393:0:8197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87a98be00 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:1.0:1787779658.303405:0:8197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98be00/0x9e63ba8af6889d8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.303412:0:8197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98be00/0x9e63ba8af6889d8a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.303420:0:8197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98e860c40700) 00010000:00010000:1.0:1787779658.303422:0:8197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787779658.303426:0:8197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98be00/0x9e63ba8af6889d8a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.303432:0:8197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98be00/0x9e63ba8af6889d8a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779658.303524:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e874223840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+52:11607:x1874622505115904:12345-192.168.201.9@tcp:34:lfs.0 Request processed in 967us (1258us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779658.303533:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 204 00010000:00010000:0.0:1787779658.355177:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787779658.368571:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779658.368678:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505116160 00000100:00100000:1.0:1787779658.368689:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505116160 00000100:00100000:1.0:1787779658.368785:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 205 00000100:00100000:1.0:1787779658.368796:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a961a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+52:11610:x1874622505116160:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:1.0:1787779658.368816:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779658.368837:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98be00/0x9e63ba8af6889d91 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedaf66 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.369135:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af6889d98 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.369151:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af6889d98 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.369182:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af6889d98 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.369198:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889d9f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.369205:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889d9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.369213:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889d9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.369377:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af6889da6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.369385:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af6889da6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.369391:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af6889da6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787779658.369400:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1787779658.369494:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af6889d98 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.369501:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af6889d98 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.369508:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af6889d98 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.369514:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87a98a400 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:1.0:1787779658.369524:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af6889d98 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.369532:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af6889d98 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.369544:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98e87450a100) 00010000:00010000:1.0:1787779658.369548:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787779658.369553:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af6889d98 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.369560:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af6889d98 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.369573:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889d9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.369579:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889d9f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.369585:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889d9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.369590:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87a98ae00 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:1.0:1787779658.369593:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889d9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.369598:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889d9f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.369604:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98e860c40300) 00010000:00010000:1.0:1787779658.369606:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787779658.369615:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889d9f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.369620:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889d9f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.369659:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98be00/0x9e63ba8af6889d91 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf66 expref: 55 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.369674:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af6889da6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf66 expref: 54 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.369682:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98e860c40700) 00010000:00010000:1.0:1787779658.369684:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787779658.369686:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87a98aa00, rc 0) 00000100:00100000:1.0:1787779658.369798:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a961a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+54:11610:x1874622505116160:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 1004us (1241us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1787779658.369807:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 205 00000100:00100000:3.0:1787779658.373934:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779658.374090:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505116288 00000100:00100000:2.0:1787779658.374100:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505116288 00000100:00100000:2.0:1787779658.374167:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 206 00000100:00100000:2.0:1787779658.374177:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e848fd5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+54:11610:x1874622505116288:12345-192.168.201.9@tcp:54:lfs.0 00010000:00010000:2.0:1787779658.374258:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67400/0x9e63ba8af6889db4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779658.374286:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67400/0x9e63ba8af6889db4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779658.374299:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67400/0x9e63ba8af6889db4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779658.374327:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67400/0x9e63ba8af6889db4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779658.374334:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67400/0x9e63ba8af6889db4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779658.374341:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67400/0x9e63ba8af6889db4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779658.374347:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87aa67400 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:2.0:1787779658.374351:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67400/0x9e63ba8af6889db4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779658.374359:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67400/0x9e63ba8af6889db4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779658.374371:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98e860c40700) 00010000:00010000:2.0:1787779658.374374:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787779658.374378:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67400/0x9e63ba8af6889db4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779658.374393:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67400/0x9e63ba8af6889db4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779658.374475:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e848fd5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+54:11610:x1874622505116288:12345-192.168.201.9@tcp:54:lfs.0 Request processed in 299us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779658.374483:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 206 00000100:00100000:3.0:1787779658.377378:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779658.381346:0:11475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505116544 00000100:00100000:0.0:1787779658.381363:0:11475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505116544 00000100:00100000:0.0:1787779658.381493:0:11475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 58 00000100:00100000:0.0:1787779658.381504:0:11475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e881ddad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+54:11610:x1874622505116544:12345-192.168.201.9@tcp:35:lfs.0 00000100:00100000:0.0:1787779658.381806:0:11475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e881ddad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+55:11610:x1874622505116544:12345-192.168.201.9@tcp:35:lfs.0 Request processed in 303us (4435us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1787779658.381827:0:11475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 58 00000100:00100000:3.0:1787779658.496129:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779658.496293:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505116800 00000100:00100000:0.0:1787779658.496302:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505116800 00000100:00100000:0.0:1787779658.496364:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 207 00000100:00100000:0.0:1787779658.496374:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e881ddbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+55:11620:x1874622505116800:12345-192.168.201.9@tcp:101:bash.0 00010000:00010000:0.0:1787779658.496400:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787779658.496403:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787779658.496428:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e840030200/0x9e63ba8af6889d36 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf4a expref: 55 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779658.496446:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98e87450a100) 00010000:00010000:0.0:1787779658.496451:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787779658.496464:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af6889dbb lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedaf6d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779658.496561:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af6889dc2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779658.496575:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af6889dc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779658.496586:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af6889dc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787779658.496597:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787779658.496782:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af6889dbb lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf6d expref: 57 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779658.496817:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af6889dc2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf6d expref: 56 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779658.496825:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98e860c40700) 00010000:00010000:0.0:1787779658.496828:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787779658.496830:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e848f69600, rc 0) 00000100:00100000:0.0:1787779658.496891:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e881ddbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+56:11620:x1874622505116800:12345-192.168.201.9@tcp:101:bash.0 Request processed in 518us (772us total) trans 4294967499 rc 0/0 00000100:00100000:0.0:1787779658.496898:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 207 00000100:00100000:3.0:1787779658.506571:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779658.506895:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505117056 00000100:00100000:2.0:1787779658.506905:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505117056 00000100:00100000:2.0:1787779658.506970:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 208 00000100:00100000:2.0:1787779658.506980:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e881dd92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+56:11620:x1874622505117056:12345-192.168.201.9@tcp:36:bash.0 00010000:00010000:2.0:1787779658.507054:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1787779658.507093:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af6889dc2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf6d expref: 56 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779658.507120:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af6889da6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf66 expref: 55 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779658.507132:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98e860c40700) 00010000:00010000:2.0:1787779658.507138:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787779658.507360:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67400/0x9e63ba8af6889dd0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779658.507374:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67400/0x9e63ba8af6889dd0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779658.507385:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67400/0x9e63ba8af6889dd0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787779658.507454:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967500 00000004:00010000:2.0:1787779658.507479:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000f67a739 reply state 00000000cff069ef transno 4294967501 ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67400/0x9e63ba8af6889dd0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779658.507488:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787779658.507588:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e881dd92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+57:11620:x1874622505117056:12345-192.168.201.9@tcp:36:bash.0 Request processed in 609us (1026us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1787779658.507597:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 208 00000020:00080000:2.0:1787779658.507602:0:5837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787779658.511872:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67400/0x9e63ba8af6889dd0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779658.511891:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67400/0x9e63ba8af6889dd0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779658.511898:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67400/0x9e63ba8af6889dd0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779658.511904:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87aa67400 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:0.0:1787779658.511909:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67400/0x9e63ba8af6889dd0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779658.511916:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67400/0x9e63ba8af6889dd0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779658.511933:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00010000:00010000:0.0:1787779658.511933:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98e860c40700) 00010000:00010000:0.0:1787779658.511936:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787779658.511941:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67400/0x9e63ba8af6889dd0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779658.511966:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67400/0x9e63ba8af6889dd0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779658.513380:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505117184 00000100:00100000:1.0:1787779658.513395:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505117184 00000100:00100000:1.0:1787779658.513462:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 209 00000100:00100000:1.0:1787779658.513527:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e881dd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+56:11620:x1874622505117184:12345-192.168.201.9@tcp:101:bash.0 00010000:00010000:1.0:1787779658.513554:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779658.513574:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98be00/0x9e63ba8af6889dd7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedaf74 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.513663:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889dde lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.513694:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889dde lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.513707:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889dde lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787779658.513754:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1787779658.513759:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787779658.513781:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889dde lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.513809:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98be00/0x9e63ba8af6889dd7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf74 expref: 58 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.513826:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889dde lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf74 expref: 57 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.513834:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98e860c40700) 00010000:00010000:1.0:1787779658.513837:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787779658.513840:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87a98ae00, rc 0) 00000100:00100000:1.0:1787779658.515322:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e881dd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+57:11620:x1874622505117184:12345-192.168.201.9@tcp:101:bash.0 Request processed in 1793us (3386us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779658.515332:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 209 00000100:00100000:3.0:1787779658.520836:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779658.520949:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505117440 00000100:00100000:1.0:1787779658.520959:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505117440 00000100:00100000:1.0:1787779658.521024:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 59 00000100:00100000:1.0:1787779658.521034:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e881ddb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+57:11620:x1874622505117440:12345-192.168.201.9@tcp:35:bash.0 00000100:00100000:1.0:1787779658.521309:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e881ddb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+58:11620:x1874622505117440:12345-192.168.201.9@tcp:35:bash.0 Request processed in 275us (481us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1787779658.521330:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 59 00000100:00100000:3.0:1787779658.602482:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779658.603117:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505117568 00000100:00100000:2.0:1787779658.603128:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505117568 00000100:00100000:2.0:1787779658.603193:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 210 00000100:00100000:2.0:1787779658.603204:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e844d283c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+58:11626:x1874622505117568:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:2.0:1787779658.603239:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779658.603263:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66000/0x9e63ba8af6889de5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedaf7b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779658.603345:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66400/0x9e63ba8af6889dec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779658.603360:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66400/0x9e63ba8af6889dec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779658.603373:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66400/0x9e63ba8af6889dec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787779658.603437:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:2.0:1787779658.603441:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787779658.603463:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66400/0x9e63ba8af6889dec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779658.603503:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66000/0x9e63ba8af6889de5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf7b expref: 60 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779658.603522:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66400/0x9e63ba8af6889dec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf7b expref: 59 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779658.603530:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98e87450a100) 00010000:00010000:2.0:1787779658.603533:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787779658.603536:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87aa66400, rc 0) 00000100:00100000:2.0:1787779658.603604:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e844d283c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+59:11626:x1874622505117568:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 403us (1133us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779658.603612:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 210 00000100:00100000:0.0:1787779658.610001:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779658.610151:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505117696 00000100:00100000:2.0:1787779658.610162:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505117696 00000100:00100000:2.0:1787779658.610236:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 211 00000100:00100000:2.0:1787779658.610247:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e855b3e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+59:11626:x1874622505117696:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:2.0:1787779658.610279:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779658.610306:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66a00/0x9e63ba8af6889df3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedaf82 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779658.610379:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af6889dfa lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779658.610395:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af6889dfa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779658.610408:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af6889dfa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779658.610439:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67000/0x9e63ba8af6889e01 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779658.610447:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67000/0x9e63ba8af6889e01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779658.610453:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67000/0x9e63ba8af6889e01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779658.610561:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af6889e08 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779658.610569:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af6889e08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779658.610576:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af6889e08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787779658.610615:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787779658.610620:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787779658.610640:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af6889e08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779658.610652:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af6889e08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779658.610660:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af6889dfa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779658.610667:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af6889dfa lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779658.610683:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af6889dfa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779658.610689:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87aa66e00 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:2.0:1787779658.610706:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af6889dfa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779658.610760:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af6889dfa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779658.610772:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98e87450a100) 00010000:00010000:2.0:1787779658.610775:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787779658.610780:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af6889dfa lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779658.610787:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af6889dfa lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779658.610799:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67000/0x9e63ba8af6889e01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779658.610805:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67000/0x9e63ba8af6889e01 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779658.610812:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67000/0x9e63ba8af6889e01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779658.610988:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87aa67000 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:2.0:1787779658.610991:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67000/0x9e63ba8af6889e01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779658.611006:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67000/0x9e63ba8af6889e01 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779658.611015:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98e84927f800) 00010000:00010000:2.0:1787779658.611017:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787779658.611020:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67000/0x9e63ba8af6889e01 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779658.611026:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67000/0x9e63ba8af6889e01 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779658.611142:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66a00/0x9e63ba8af6889df3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf82 expref: 61 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779658.611158:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af6889e08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf82 expref: 60 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779658.611167:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98e860c40700) 00010000:00010000:2.0:1787779658.611169:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787779658.611172:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87aa67e00, rc 0) 00000100:00100000:2.0:1787779658.611252:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e855b3e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+60:11626:x1874622505117696:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 1005us (1262us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779658.611260:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 211 00000100:00100000:3.0:1787779658.624464:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779658.624517:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779658.624688:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505117824 00000100:00100000:1.0:1787779658.624709:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505117824 00000100:00100000:1.0:1787779658.624826:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 16 00000100:00100000:1.0:1787779658.624837:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e844d29e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+60:2360:x1874622505117824:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787779658.624855:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787779658.624881:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67e00/0x9e63ba8af6889e08 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf82 expref: 60 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.624901:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98e860c40700) 00010000:00010000:1.0:1787779658.624907:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787779658.624978:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e844d29e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+59:2360:x1874622505117824:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 135us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779658.624987:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 16 00000100:00100000:0.0:1787779658.625061:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505118080 00000100:00100000:0.0:1787779658.625066:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505118080 00000100:00100000:0.0:1787779658.625113:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 212 00000100:00100000:0.0:1787779658.625121:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e844d2bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+59:11626:x1874622505118080:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:0.0:1787779658.625141:0:8197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787779658.625159:0:8197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af6889e0f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedaf89 expref: -99 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779658.625257:0:8197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68800/0x9e63ba8af6889e16 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779658.625281:0:8197:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889dde lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf74 expref: 60 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779658.625291:0:8197:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68800/0x9e63ba8af6889e16 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779658.625324:0:8197:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889dde lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf74 expref: 60 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779658.625337:0:8197:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889dde lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf74 expref: 60 pid: 5835 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779658.625350:0:8197:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87a708780 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8197:1874622525031936:192.168.201.9@tcp:104: 00000100:00100000:0.0:1787779658.625424:0:8197:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e845f4f180 going to sleep for 11 seconds 00000100:00100000:0.0:1787779658.631967:0:8197:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87a708780 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8197:1874622525031936:192.168.201.9@tcp:104: 00010000:00010000:0.0:1787779658.632005:0:8197:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68800/0x9e63ba8af6889e16 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779658.636640:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779658.636751:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505118208 00000100:00100000:2.0:1787779658.636764:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505118208 00010000:00010000:2.0:1787779658.636807:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889dde lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf74 expref: 61 pid: 5835 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779658.636879:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 77 00000100:00100000:2.0:1787779658.636889:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e844d29a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+61:2359:x1874622505118208:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787779658.636907:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787779658.636915:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889dde lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf74 expref: 61 pid: 5835 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779658.636928:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889dde lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf74 expref: 61 pid: 5835 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779658.636953:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889dde lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf74 expref: 61 pid: 5835 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779658.636970:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98e860c40700) 00010000:00010000:2.0:1787779658.636976:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68800/0x9e63ba8af6889e16 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779658.636986:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68800/0x9e63ba8af6889e16 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779658.636995:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68800/0x9e63ba8af6889e16 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779658.637028:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787779658.637084:0:8197:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68800/0x9e63ba8af6889e16 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779658.637092:0:8197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68800/0x9e63ba8af6889e16 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779658.637094:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e844d29a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+60:2359:x1874622505118208:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 206us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779658.637101:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 77 00000004:00200000:0.0:1787779658.637114:0:8197:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1787779658.637264:0:8197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af6889e0f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf89 expref: 61 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779658.637288:0:8197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68800/0x9e63ba8af6889e16 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf89 expref: 60 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779658.637296:0:8197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98e860c40700) 00010000:00010000:0.0:1787779658.637298:0:8197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787779658.637301:0:8197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e848f68800, rc 0) 00000100:00100000:0.0:1787779658.637325:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e844d2bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+60:11626:x1874622505118080:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 12205us (12808us total) trans 4294967503 rc 0/0 00000100:00100000:0.0:1787779658.637332:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 212 00000100:00100000:1.0:1787779658.642120:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779658.642235:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505118464 00000100:00100000:3.0:1787779658.642246:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505118464 00000100:00100000:3.0:1787779658.642384:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 17 00000100:00100000:3.0:1787779658.642395:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e845c70780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+60:11626:x1874622505118464:12345-192.168.201.9@tcp:103:lfs.0 00010000:00010000:3.0:1787779658.642413:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787779658.642441:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af6889d75 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf5f expref: 60 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779658.642461:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98e860c40700) 00010000:00010000:3.0:1787779658.642466:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787779658.642526:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e845c70780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+59:11626:x1874622505118464:12345-192.168.201.9@tcp:103:lfs.0 Request processed in 132us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779658.642548:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 17 00000100:00100000:3.0:1787779658.653462:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779658.656219:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505118592 00000100:00100000:1.0:1787779658.656233:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505118592 00000100:00100000:1.0:1787779658.656330:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 213 00000100:00100000:1.0:1787779658.656341:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e844d292c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+59:11626:x1874622505118592:12345-192.168.201.9@tcp:58:lfs.0 00010000:00010000:1.0:1787779658.656472:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98be00/0x9e63ba8af6889e24 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.656490:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98be00/0x9e63ba8af6889e24 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.656500:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98be00/0x9e63ba8af6889e24 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787779658.656954:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1787779658.657097:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e844d292c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+59:11626:x1874622505118592:12345-192.168.201.9@tcp:58:lfs.0 Request processed in 758us (3646us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779658.657104:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 213 00000100:00100000:0.0:1787779658.664123:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779658.664312:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505118720 00000100:00100000:1.0:1787779658.664322:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505118720 00000100:00100000:1.0:1787779658.664385:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 214 00000100:00100000:1.0:1787779658.664395:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a708780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+59:11626:x1874622505118720:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:1.0:1787779658.664421:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779658.664442:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af6889e2b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedaf90 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.664504:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98be00/0x9e63ba8af6889e24 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.664514:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af6889e2b lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf90 expref: 60 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.664532:0:5837:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98be00/0x9e63ba8af6889e24 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.664543:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af6889e2b lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf90 expref: 60 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.664555:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98e860c40700) 00010000:00010000:1.0:1787779658.664558:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787779658.664562:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af6889e2b lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf90 expref: 60 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779658.664582:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87a98a400, rc 0) 00000100:00100000:1.0:1787779658.664640:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a708780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+60:11626:x1874622505118720:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 247us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779658.664648:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 214 00000100:00100000:2.0:1787779658.676351:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e845c73c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622525032064:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787779658.676764:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779658.682613:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525032064 00000100:00100000:3.0:1787779658.682633:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525032064 00000100:00100000:3.0:1787779658.682753:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787779658.682764:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e881d81a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622525032064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787779658.682794:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3855613952 00000100:00100000:3.0:1787779658.682894:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e881d81a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622525032064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 132us (6129us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779658.682902:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787779658.683058:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:0.0:1787779658.683073:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967309 00000004:00080000:0.0:1787779658.683094:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98e848fd7840, transno 4294967307 00000004:00080000:0.0:1787779658.683124:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967309 00000100:00100000:0.0:1787779658.683147:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e845c73c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622525032064:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1787779659.059016:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787779659.059027:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787779659.059074:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1787779659.059082:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787779659.059203:0:11684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e848fd7840 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11684:1874622525032192:192.168.201.9@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787779659.059336:0:11684:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e743665cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787779659.076855:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779659.077028:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505118848 00000100:00100000:2.0:1787779659.077038:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505118848 00000100:00100000:2.0:1787779659.077099:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 215 00000100:00100000:2.0:1787779659.077109:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a70b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+61:11627:x1874622505118848:12345-192.168.201.9@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787779659.077143:0:5836:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787779659.077244:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a70b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+61:11627:x1874622505118848:12345-192.168.201.9@tcp:53:lhsmtool_posix.0 Request processed in 136us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779659.077250:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 215 00000100:00100000:3.0:1787779659.079358:0:11684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e848fd7840 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11684:1874622525032192:192.168.201.9@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787779659.082125:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779659.082359:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505118976 00000100:00100000:2.0:1787779659.082370:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505118976 00000100:00100000:2.0:1787779659.082445:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 216 00000100:00100000:2.0:1787779659.082455:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e845c70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+60:11627:x1874622505118976:12345-192.168.201.9@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787779659.082530:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af6889e32 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.082549:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af6889e32 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.082560:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af6889e32 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.082594:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66000/0x9e63ba8af6889e39 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.082602:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66000/0x9e63ba8af6889e39 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.082609:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66000/0x9e63ba8af6889e39 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.082650:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af6889e40 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.082660:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af6889e40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.082667:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af6889e40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787779659.082708:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787779659.082758:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787779659.082771:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af6889e40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.082782:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af6889e32 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.082788:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af6889e32 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.082796:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af6889e32 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.082802:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87aa66e00 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:2.0:1787779659.082806:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af6889e32 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.082813:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af6889e32 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.082825:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98e84927fc00) 00010000:00010000:2.0:1787779659.082834:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787779659.082839:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af6889e32 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.082845:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af6889e32 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.082860:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66000/0x9e63ba8af6889e39 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.082866:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66000/0x9e63ba8af6889e39 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.082872:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66000/0x9e63ba8af6889e39 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.082876:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87aa66000 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:2.0:1787779659.082879:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66000/0x9e63ba8af6889e39 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.082885:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66000/0x9e63ba8af6889e39 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.082892:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff98e84927f800) 00010000:00010000:2.0:1787779659.082895:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787779659.082897:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66000/0x9e63ba8af6889e39 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.082902:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66000/0x9e63ba8af6889e39 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.082926:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af6889e40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.082947:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af6889e40 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.082953:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af6889e40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.082958:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87aa66200 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:2.0:1787779659.082961:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af6889e40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.082967:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af6889e40 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.082975:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98e860c40700) 00010000:00010000:2.0:1787779659.082977:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787779659.082980:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af6889e40 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.082985:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af6889e40 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779659.083072:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e845c70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+60:11627:x1874622505118976:12345-192.168.201.9@tcp:34:lhsmtool_posix.0 Request processed in 617us (955us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779659.083081:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 216 00000100:00100000:2.0:1787779659.087484:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779659.087651:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505119232 00000100:00100000:3.0:1787779659.087662:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505119232 00000100:00100000:3.0:1787779659.087745:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 217 00000100:00100000:3.0:1787779659.087755:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f61da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+60:11627:x1874622505119232:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787779659.087827:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779659.087853:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889e47 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedaf97 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779659.087965:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af6889e4e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779659.087980:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af6889e4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779659.087990:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af6889e4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787779659.087999:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787779659.088102:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af6889e4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779659.088107:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af6889e4e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779659.088112:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af6889e4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779659.088116:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87a98aa00 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:1.0:1787779659.088131:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af6889e4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779659.088136:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af6889e4e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779659.088145:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98e860c40700) 00010000:00010000:1.0:1787779659.088148:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787779659.088151:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af6889e4e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779659.088156:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af6889e4e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779659.088189:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889e47 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf97 expref: 62 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779659.088195:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98e84927fc00) 00010000:00010000:1.0:1787779659.088197:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787779659.088199:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889e47 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf97 expref: 62 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779659.088205:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87a98ae00, rc 0) 00000100:00100000:1.0:1787779659.088427:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f61da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+61:11627:x1874622505119232:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 Request processed in 673us (955us total) trans 4294967504 rc 301/301 00000100:00100000:1.0:1787779659.088435:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 217 00000100:00100000:3.0:1787779659.090613:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779659.090656:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505119360 00000100:00100000:2.0:1787779659.090666:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505119360 00000100:00100000:2.0:1787779659.090789:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 218 00000100:00100000:2.0:1787779659.090799:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e848fd7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+61:11627:x1874622505119360:12345-192.168.201.9@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787779659.090860:0:5837:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787779659.090967:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e848fd7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+61:11627:x1874622505119360:12345-192.168.201.9@tcp:53:lhsmtool_posix.0 Request processed in 168us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779659.090975:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 218 00000100:00100000:1.0:1787779659.104229:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779659.104340:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505119616 00000100:00100000:3.0:1787779659.104352:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505119616 00000100:00100000:3.0:1787779659.104411:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 219 00000100:00100000:3.0:1787779659.104421:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e845c73c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+61:11627:x1874622505119616:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787779659.105118:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779659.105123:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787779659.105151:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66400/0x9e63ba8af6889dec lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf7b expref: 61 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779659.105169:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98e87450a100) 00010000:00010000:3.0:1787779659.105173:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787779659.105185:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5800/0x9e63ba8af6889e5c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedaf9e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787779659.105698:0:5836:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:3.0:1787779659.106002:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af6889e63 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779659.106016:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af6889e63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779659.106026:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af6889e63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779659.106079:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5800/0x9e63ba8af6889e5c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf9e expref: 63 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779659.106092:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af6889e63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf9e expref: 62 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779659.106100:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98e87450a700) 00010000:00010000:3.0:1787779659.106103:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787779659.106116:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e8429d5000, rc 0) 00000100:00100000:3.0:1787779659.106179:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e845c73c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+62:11627:x1874622505119616:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 Request processed in 1759us (1960us total) trans 4294967505 rc 0/0 00000100:00100000:3.0:1787779659.106188:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 219 00000100:00100000:1.0:1787779659.109698:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779659.110048:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505119872 00000100:00100000:2.0:1787779659.110059:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505119872 00000100:00100000:2.0:1787779659.110118:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 220 00000100:00100000:2.0:1787779659.110128:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e845c71e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+62:11627:x1874622505119872:12345-192.168.201.9@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787779659.110186:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787779659.110213:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af6889e63 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf9e expref: 62 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.110233:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98e87450a700) 00010000:00010000:2.0:1787779659.110244:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787779659.110289:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af6889e71 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.110303:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af6889e71 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.110313:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af6889e71 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.110370:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66000/0x9e63ba8af6889e78 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x5ee04326 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.110379:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66000/0x9e63ba8af6889e78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x5ee04326 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.110403:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66000/0x9e63ba8af6889e78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x5ee04326 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.110476:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af6889e71 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.110483:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af6889e71 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.110490:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af6889e71 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.110495:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87aa66200 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:2.0:1787779659.110499:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af6889e71 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.110506:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af6889e71 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.110514:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98e87450a100) 00010000:00010000:2.0:1787779659.110517:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787779659.110520:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af6889e71 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.110526:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af6889e71 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.110534:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66000/0x9e63ba8af6889e78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x5ee04326 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.110539:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66000/0x9e63ba8af6889e78 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x5ee04326 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.110551:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66000/0x9e63ba8af6889e78 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x5ee04326 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.110556:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87aa66000 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:2.0:1787779659.110558:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66000/0x9e63ba8af6889e78 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x5ee04326 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.110564:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66000/0x9e63ba8af6889e78 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x5ee04326 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.110570:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x5ee04326 (ffff98e84927f800) 00010000:00010000:2.0:1787779659.110572:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787779659.110574:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66000/0x9e63ba8af6889e78 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x5ee04326 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.110580:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66000/0x9e63ba8af6889e78 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x5ee04326 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779659.110668:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e845c71e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+61:11627:x1874622505119872:12345-192.168.201.9@tcp:36:lhsmtool_posix.0 Request processed in 536us (974us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787779659.110677:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 220 00000100:00100000:0.0:1787779659.112168:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779659.112275:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505120000 00000100:00100000:1.0:1787779659.112284:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505120000 00000100:00100000:1.0:1787779659.112338:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 221 00000100:00100000:1.0:1787779659.112347:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87fd28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+61:11627:x1874622505120000:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787779659.112366:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779659.112387:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889e7f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedafa5 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779659.112418:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af6889e86 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779659.112430:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af6889e86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779659.112440:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af6889e86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779659.112522:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af6889e7f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedafa5 expref: 63 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779659.112538:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af6889e86 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedafa5 expref: 62 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779659.112545:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98e860c40300) 00010000:00010000:1.0:1787779659.112548:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787779659.112551:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87a98aa00, rc 0) 00000100:00100000:1.0:1787779659.112599:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87fd28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+62:11627:x1874622505120000:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 Request processed in 253us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779659.112607:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 221 00000100:00100000:3.0:1787779659.114531:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779659.114582:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505120256 00000100:00100000:2.0:1787779659.114591:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505120256 00000100:00100000:2.0:1787779659.114691:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 222 00000100:00100000:2.0:1787779659.114701:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ab18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+62:11627:x1874622505120256:12345-192.168.201.9@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787779659.114803:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af6889e8d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.114819:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af6889e8d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.114841:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af6889e8d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787779659.115095:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:2.0:1787779659.115105:0:5837:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 424856392817ns, next at 425856390439ns, rc = 0 00000004:00010000:2.0:1787779659.115184:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f5d4bb2f reply state 0000000019387054 transno 4294967506 ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af6889e8d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779659.115193:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787779659.115303:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ab18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+64:11627:x1874622505120256:12345-192.168.201.9@tcp:36:lhsmtool_posix.0 Request processed in 602us (780us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1787779659.115311:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 222 00010000:00010000:1.0:1787779659.116273:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af6889e8d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779659.116297:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af6889e8d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779659.116304:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af6889e8d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779659.116310:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87aa66e00 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:1.0:1787779659.116314:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af6889e8d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779659.116321:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af6889e8d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779659.116334:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98e860c40300) 00010000:00010000:1.0:1787779659.116337:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787779659.116343:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af6889e8d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779659.116349:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66e00/0x9e63ba8af6889e8d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779659.117200:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779659.117323:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505120384 00000100:00100000:1.0:1787779659.117331:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505120384 00000100:00100000:1.0:1787779659.117429:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 223 00000100:00100000:1.0:1787779659.117440:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ab1b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+63:11627:x1874622505120384:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787779659.117464:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779659.117482:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98bc00/0x9e63ba8af6889e94 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedafac expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779659.117545:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98bc00/0x9e63ba8af6889e94 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedafac expref: 64 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779659.117558:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98bc00/0x9e63ba8af6889e94 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedafac expref: 64 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779659.117575:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98e860c40300) 00010000:00010000:1.0:1787779659.117578:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787779659.117581:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87a98bc00, rc 0) 00000100:00100000:1.0:1787779659.117632:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ab1b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+64:11627:x1874622505120384:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 Request processed in 193us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779659.117639:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 223 00000100:00100000:3.0:1787779659.119355:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779659.119413:0:10229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505120512 00000100:00100000:0.0:1787779659.119421:0:10229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505120512 00000100:00100000:0.0:1787779659.119510:0:10229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 63 00000100:00100000:0.0:1787779659.119519:0:10229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f539a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+9:2359:x1874622505120512:12345-192.168.201.9@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787779659.119816:0:10229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f539a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+10:2359:x1874622505120512:12345-192.168.201.9@tcp:2:lhsmtool_posix.0 Request processed in 297us (466us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1787779659.119824:0:10229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 63 00000100:00080000:2.0:1787779659.120028:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787779659.121139:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779659.121193:0:11475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505120768 00000100:00100000:0.0:1787779659.121200:0:11475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505120768 00000100:00100000:0.0:1787779659.121285:0:11475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 60 00000100:00100000:0.0:1787779659.121292:0:11475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f5392c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+64:11627:x1874622505120768:12345-192.168.201.9@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787779659.121467:0:11475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f5392c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+65:11627:x1874622505120768:12345-192.168.201.9@tcp:35:lhsmtool_posix.0 Request processed in 175us (331us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1787779659.121474:0:11475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 60 00000100:00100000:2.0:1787779659.122843:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779659.122910:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505121024 00000100:00100000:3.0:1787779659.122916:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505121024 00000100:00100000:3.0:1787779659.122967:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 224 00000100:00100000:3.0:1787779659.122975:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e848f37840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+65:11627:x1874622505121024:12345-192.168.201.9@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787779659.123057:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e848f37840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+65:11627:x1874622505121024:12345-192.168.201.9@tcp:57:lhsmtool_posix.0 Request processed in 83us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779659.123065:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 224 00000100:00100000:1.0:1787779659.125618:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779659.125689:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505121152 00000100:00100000:0.0:1787779659.125697:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505121152 00000100:00100000:0.0:1787779659.125774:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 225 00000100:00100000:0.0:1787779659.125793:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e845c73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+65:11627:x1874622505121152:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787779659.125813:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787779659.125834:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af6889e9b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedafb3 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779659.126157:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68a00/0x9e63ba8af6889ea2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779659.126172:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68a00/0x9e63ba8af6889ea2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779659.126182:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68a00/0x9e63ba8af6889ea2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787779659.126227:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787779659.126245:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68a00/0x9e63ba8af6889ea2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779659.126345:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69200/0x9e63ba8af6889e9b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedafb3 expref: 67 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779659.126363:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68a00/0x9e63ba8af6889ea2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedafb3 expref: 66 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779659.126371:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98e860c40300) 00010000:00010000:0.0:1787779659.126374:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787779659.126377:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e848f68a00, rc 0) 00000100:00100000:0.0:1787779659.126435:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e845c73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+66:11627:x1874622505121152:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 Request processed in 652us (824us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779659.126443:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 225 00000100:00100000:1.0:1787779659.132941:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779659.133370:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505121280 00000100:00100000:2.0:1787779659.133381:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505121280 00000100:00100000:2.0:1787779659.133456:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 64 00000100:00100000:2.0:1787779659.133467:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e845c730c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+10:2359:x1874622505121280:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787779659.133489:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779659.133698:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c416203/0x9e63ba8af6889ea9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedafba expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787779659.133747:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8f5a4a, blocks: 0x1 00010000:00010000:2.0:1787779659.133769:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=424s v=(0 0) 00010000:00010000:2.0:1787779659.133773:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787779659.133783:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c416203/0x9e63ba8af6889ea9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedafba expref: 11 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.133833:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c416203/0x9e63ba8af6889ea9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedafba expref: 11 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.133849:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87aa66200, rc 0) 00000100:00100000:2.0:1787779659.133912:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e845c730c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+11:2359:x1874622505121280:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 Request processed in 446us (976us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779659.133919:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 64 00000100:00100000:2.0:1787779659.138088:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779659.138203:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505121536 00000100:00100000:3.0:1787779659.138223:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505121536 00000100:00100000:3.0:1787779659.138295:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 226 00000100:00100000:3.0:1787779659.138305:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e848f36d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+66:11627:x1874622505121536:12345-192.168.201.9@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787779659.138416:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e848f36d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+66:11627:x1874622505121536:12345-192.168.201.9@tcp:57:lhsmtool_posix.0 Request processed in 113us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779659.138424:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 226 00000100:00100000:1.0:1787779659.141359:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779659.141753:0:10229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505121664 00000100:00100000:0.0:1787779659.141763:0:10229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505121664 00000100:00100000:0.0:1787779659.141810:0:10229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 65 00000100:00100000:0.0:1787779659.141831:0:10229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ab36d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+11:11627:x1874622505121664:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787779659.141848:0:10229:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787779659.141865:0:10229:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000304b3d25/0x9e63ba8af6889eb0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedafc1 expref: -99 pid: 10229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779659.141908:0:10229:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001c416203/0x9e63ba8af6889ea9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedafba expref: 12 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779659.141917:0:10229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787779659.141921:0:10229:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787779659.141926:0:10229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000304b3d25/0x9e63ba8af6889eb0 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedafc1 expref: 12 pid: 10229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779659.141958:0:10229:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001c416203/0x9e63ba8af6889ea9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedafba expref: 12 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779659.141972:0:10229:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001c416203/0x9e63ba8af6889ea9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedafba expref: 12 pid: 6680 timeout: 524 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779659.141986:0:10229:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e845d2ed00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10229:1874622525032320:192.168.201.9@tcp:104: 00000100:00100000:0.0:1787779659.142085:0:10229:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e845f4f180 going to sleep for 11 seconds 00000100:00100000:1.0:1787779659.149754:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779659.150532:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505121792 00000100:00100000:2.0:1787779659.150543:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505121792 00010000:00010000:2.0:1787779659.150590:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001c416203/0x9e63ba8af6889ea9 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedafba expref: 13 pid: 6680 timeout: 524 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779659.150636:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 78 00000100:00100000:2.0:1787779659.150646:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ab352c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+13:2360:x1874622505121792:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787779659.150660:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787779659.150682:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001c416203/0x9e63ba8af6889ea9 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedafba expref: 13 pid: 6680 timeout: 524 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.150697:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001c416203/0x9e63ba8af6889ea9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedafba expref: 13 pid: 6680 timeout: 524 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.150751:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787779659.150756:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787779659.150777:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000304b3d25/0x9e63ba8af6889eb0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedafc1 expref: 13 pid: 10229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.150789:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000304b3d25/0x9e63ba8af6889eb0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedafc1 expref: 13 pid: 10229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.152776:0:5823:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000304b3d25/0x9e63ba8af6889eb0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedafc1 expref: 13 pid: 10229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779659.152941:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e848f34780 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5823:1874622525032448:192.168.201.9@tcp:105: 00000100:00100000:2.0:1787779659.153048:0:5823:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e87eb46cc0 going to sleep for 11 seconds 00010000:00010000:0.0:1787779659.154113:0:10229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c416203/0x9e63ba8af6889ea9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedafba expref: 13 pid: 6680 timeout: 524 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779659.154135:0:10229:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e845d2ed00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10229:1874622525032320:192.168.201.9@tcp:104: 00010000:00010000:0.0:1787779659.154192:0:10229:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000304b3d25/0x9e63ba8af6889eb0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedafc1 expref: 12 pid: 10229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779659.154208:0:10229:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e848f69200, rc 0) 00000100:00100000:3.0:1787779659.161027:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e848f34780 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5823:1874622525032448:192.168.201.9@tcp:105: 00010000:00010000:3.0:1787779659.161055:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787779659.161119:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ab352c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+12:2360:x1874622505121792:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 10474us (11414us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779659.161148:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 78 00000100:00100000:1.0:1787779659.162737:0:10229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ab36d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+11:11627:x1874622505121664:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 Request processed in 20897us (21479us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779659.162750:0:10229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 65 00000100:00100000:2.0:1787779659.172559:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779659.172648:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505121920 00000100:00100000:3.0:1787779659.172660:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505121920 00002000:00100000:3.0:1787779659.172754:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff98e848f34780 x1874622505121920/t0(0) o4->e225400f-8d32-48a8-ab5e-fe4d3780a20c@192.168.201.9@tcp:70/0 lens 504/0 e 0 to 0 dl 1787779670 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787779659.172766:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98e848f34780 with x1874622505121920 ext(0->12) 00002000:00010000:3.0:1787779659.172772:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98e848f34780 00000100:00100000:3.0:1787779659.172797:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 7 00000100:00100000:3.0:1787779659.172805:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e848f34780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+11:2359:x1874622505121920:12345-192.168.201.9@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787779659.173232:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e848f34780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+13:2359:x1874622505121920:12345-192.168.201.9@tcp:4:lhsmtool_posix.0 Request processed in 427us (682us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1787779659.173241:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 7 00002000:00100000:3.0:1787779659.173247:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff98e848f34780 x1874622505121920/t4294967320(0) o4->e225400f-8d32-48a8-ab5e-fe4d3780a20c@192.168.201.9@tcp:70/0 lens 504/448 e 0 to 0 dl 1787779670 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787779659.173504:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98e848f34780 with x1874622505121920 ext(0->12) 00002000:00010000:3.0:1787779659.173508:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98e848f34780 00000100:00100000:3.0:1787779659.175854:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779659.176391:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505122048 00000100:00100000:1.0:1787779659.176404:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505122048 00000100:00100000:1.0:1787779659.176477:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 227 00000100:00100000:1.0:1787779659.176488:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f539680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+66:11627:x1874622505122048:12345-192.168.201.9@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1787779659.215502:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f539680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+66:11627:x1874622505122048:12345-192.168.201.9@tcp:44:lhsmtool_posix.0 Request processed in 39008us (39654us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779659.215512:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 227 00000001:00080000:3.0:1787779659.216482:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967507 is committed 00000004:00080000:3.0:1787779659.216512:0:5857:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:3.0:1787779659.216987:0:5857:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000004:00080000:3.0:1787779659.217009:0:5857:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:3.0:1787779659.217111:0:5857:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98e87a716d80 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1787779659.217116:0:5857:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98e87f500400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98e87a7166c0 00000020:00080000:3.0:1787779659.217119:0:5857:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98e87f500000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98e87aa4a400 00000100:00100000:1.0:1787779659.217124:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000004:00080000:3.0:1787779659.217145:0:5857:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000020:00080000:0.0:1787779659.217182:0:5868:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:0.0:1787779659.217192:0:5868:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:3.0:1787779659.217326:0:5857:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98e85191acc0 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1787779659.217330:0:5857:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98e87f502d00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98e85191a900 00000020:00080000:3.0:1787779659.217333:0:5857:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98e87f502f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98e873975400 00000020:00080000:0.0:1787779659.217366:0:5868:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000100:00100000:1.0:1787779659.217421:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f6b7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874622525032576:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787779659.217470:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1787779659.217549:0:5868:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1787779659.217557:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787779659.217563:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f6b5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874622525032704:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787779659.217591:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779659.217627:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e852b9e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622525032832:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787779659.217655:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779659.217686:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505122176 00000100:00100000:3.0:1787779659.217692:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505122176 00000100:00100000:2.0:1787779659.217701:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525032576 00000100:00100000:2.0:1787779659.217705:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525032576 00000100:00100000:0.0:1787779659.217741:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525032704 00000100:00100000:2.0:1787779659.217742:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525032832 00000100:00100000:2.0:1787779659.217744:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525032832 00000100:00100000:0.0:1787779659.217744:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525032704 00000100:00100000:2.0:1787779659.217759:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787779659.217766:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87aa321c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3304:x1874622525032576:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787779659.217789:0:6680:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00000100:00100000:0.0:1787779659.217803:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787779659.217811:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e852b9f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622525032832:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1787779659.217824:0:6681:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:0.0:1787779659.217853:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a8f5a49, atime: 0x6a8f5a49, ctime: 0x6a8f5a49, blocks: 0xb 00010000:00010000:0.0:1787779659.217861:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000017c94cdd/0x9e63ba8af6889eb7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.217923:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035afe464/0x9e63ba8af6889ebe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779659.217928:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=424s v=(0 0) 00010000:00010000:0.0:1787779659.217934:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787779659.217937:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004a4d0f41/0x9e63ba8af6889c79 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf20 expref: 13 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779659.217940:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000017c94cdd/0x9e63ba8af6889eb7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.217954:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787779659.217955:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000017c94cdd/0x9e63ba8af6889eb7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779659.217964:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000017c94cdd/0x9e63ba8af6889eb7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.217966:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787779659.217972:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035afe464/0x9e63ba8af6889ebe lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779659.217982:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000017c94cdd/0x9e63ba8af6889eb7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779659.218005:0:6681:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787779659.218008:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004a4d0f41/0x9e63ba8af6889c79 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf20 expref: 13 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.218112:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004a4d0f41/0x9e63ba8af6889c79 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf20 expref: 13 pid: 6680 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779659.218124:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ec992c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1874622525032960:192.168.201.9@tcp:104: 00000100:00100000:2.0:1787779659.218171:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e87eb46540 going to sleep for 11 seconds 00000100:00100000:0.0:1787779659.218502:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e852b9f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3306:x1874622525032832:12345-0@lo:6:osp-syn-1-0.0 Request processed in 691us (845us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1787779659.218509:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787779659.218525:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787779659.218532:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e855a63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3304:x1874622525032704:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1787779659.218537:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98e852b9e1c0/2, rc 0, transno 4294967310 00000100:00100000:2.0:1787779659.218543:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e852b9e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622525032832:0@lo:6:osp-syn-1-0.0 00002000:00010000:0.0:1787779659.218618:0:6681:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787779659.218621:0:6681:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1787779658 00002000:00010000:0.0:1787779659.218623:0:6681:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787779659.218624:0:6681:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1787779658 -> 1787779658 00002000:00010000:0.0:1787779659.218625:0:6681:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1787779659.218654:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e855a63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3304:x1874622525032704:12345-0@lo:2:osp-syn-0-0.0 Request processed in 122us (1061us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1787779659.218659:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000004:00080000:2.0:1787779659.218680:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98e87f6b5a40/2, rc 0, transno 4294967321 00000100:00100000:2.0:1787779659.218685:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f6b5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874622525032704:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1787779659.218731:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787779659.218738:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000017c94cdd/0x9e63ba8af6889eb7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779659.218747:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e848f69800 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:1.0:1787779659.218751:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000017c94cdd/0x9e63ba8af6889eb7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779659.218760:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000017c94cdd/0x9e63ba8af6889eb7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779659.218774:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000017c94cdd/0x9e63ba8af6889eb7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779659.218779:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000017c94cdd/0x9e63ba8af6889eb7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779659.218793:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779659.218794:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779659.218795:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779659.218886:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 69 00000100:00100000:3.0:1787779659.218893:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ab34f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+13:2360:x1874622505122176:12345-192.168.201.9@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1787779659.223740:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779659.223758:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ec992c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1874622525032960:192.168.201.9@tcp:104: 00000100:00100000:0.0:1787779659.223769:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505122304 00000100:00100000:0.0:1787779659.223775:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505122304 00010000:00010000:2.0:1787779659.223784:0:6680:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000035afe464/0x9e63ba8af6889ebe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779659.224144:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004a4d0f41/0x9e63ba8af6889c79 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf20 expref: 14 pid: 6680 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779659.224181:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 79 00000100:00100000:0.0:1787779659.224191:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e847d96c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+14:2360:x1874622505122304:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787779659.224218:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787779659.224224:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004a4d0f41/0x9e63ba8af6889c79 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf20 expref: 14 pid: 6680 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779659.224237:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004a4d0f41/0x9e63ba8af6889c79 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf20 expref: 14 pid: 6680 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779659.224258:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a4d0f41/0x9e63ba8af6889c79 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf20 expref: 14 pid: 6680 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779659.224287:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787779659.224292:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787779659.224297:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000035afe464/0x9e63ba8af6889ebe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779659.224306:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035afe464/0x9e63ba8af6889ebe lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779659.224328:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787779659.224372:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e847d96c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+13:2360:x1874622505122304:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 184us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779659.224380:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 79 00010000:00010000:2.0:1787779659.225337:0:6680:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000035afe464/0x9e63ba8af6889ebe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.225364:0:6680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000035afe464/0x9e63ba8af6889ebe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.225374:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035afe464/0x9e63ba8af6889ebe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.225382:0:6680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000035afe464/0x9e63ba8af6889ebe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.225411:0:6680:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787779659.225573:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787779659.225580:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000035afe464/0x9e63ba8af6889ebe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779659.225598:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87aa67200 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:0.0:1787779659.225602:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000035afe464/0x9e63ba8af6889ebe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779659.225612:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000035afe464/0x9e63ba8af6889ebe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779659.225627:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000035afe464/0x9e63ba8af6889ebe lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779659.225634:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000035afe464/0x9e63ba8af6889ebe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779659.225662:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779659.225664:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779659.225666:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787779659.228529:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87aa321c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3304:x1874622525032576:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10755us (11050us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1787779659.228542:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000004:00080000:3.0:1787779659.228558:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98e87f6b7840/2, rc 0, transno 4294967322 00000100:00100000:3.0:1787779659.228564:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f6b7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874622525032576:0@lo:6:osp-syn-0-0.0 00000001:00080000:2.0:1787779659.241571:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000001:00080000:2.0:1787779659.241590:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967319 is committed 00000001:00080000:2.0:1787779659.241598:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000100:00100000:3.0:1787779659.241781:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ab34f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+7:2360:x1874622505122176:12345-192.168.201.9@tcp:16:lhsmtool_posix.0 Request processed in 22881us (24652us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779659.241794:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 69 00000100:00100000:0.0:1787779659.243833:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779659.243884:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505122560 00000100:00100000:3.0:1787779659.243894:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505122560 00000100:00100000:3.0:1787779659.243954:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 228 00000100:00100000:3.0:1787779659.244173:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e845d2ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+20:11627:x1874622505122560:12345-192.168.201.9@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787779659.244223:0:8197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787779659.244249:0:8197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68a00/0x9e63ba8af6889ea2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedafb3 expref: 20 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779659.244298:0:8197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98e860c40300) 00010000:00010000:3.0:1787779659.244315:0:8197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787779659.244342:0:8197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af6889ec5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779659.244352:0:8197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af6889ec5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779659.244359:0:8197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af6889ec5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787779659.244550:0:8197:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005e11737e reply state 00000000c562f70b transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af6889ec5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779659.244557:0:8197:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787779659.244632:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e845d2ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+21:11627:x1874622505122560:12345-192.168.201.9@tcp:36:lhsmtool_posix.0 Request processed in 461us (805us total) trans 4294967508 rc 0/0 00000100:00100000:3.0:1787779659.244639:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 228 00010000:00010000:3.0:1787779659.245927:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af6889ec5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779659.245940:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af6889ec5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779659.245946:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af6889ec5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779659.245952:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e8429d4400 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:3.0:1787779659.245957:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af6889ec5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779659.245965:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af6889ec5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779659.245993:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98e860c40300) 00010000:00010000:3.0:1787779659.245997:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779659.246003:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af6889ec5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779659.246010:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af6889ec5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779659.246541:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779659.246749:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505122688 00000100:00100000:1.0:1787779659.246757:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505122688 00000100:00100000:1.0:1787779659.246803:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 70 00000100:00100000:1.0:1787779659.246812:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e845d2fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+7:2359:x1874622505122688:12345-192.168.201.9@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787779659.246996:0:6681:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1787779659.247000:0:6681:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1787779658 -> 1787779657 00002000:00010000:1.0:1787779659.247002:0:6681:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1787779657 00002000:00010000:1.0:1787779659.247005:0:6681:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1787779658 -> 1787779657 00002000:00010000:1.0:1787779659.247007:0:6681:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1787779659.247100:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e845d2fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+8:2359:x1874622505122688:12345-192.168.201.9@tcp:2:lhsmtool_posix.0 Request processed in 289us (561us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1787779659.247108:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 70 00000100:00100000:0.0:1787779659.248414:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779659.248462:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505122944 00000100:00100000:1.0:1787779659.248468:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505122944 00000100:00100000:1.0:1787779659.248533:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 229 00000100:00100000:1.0:1787779659.248540:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e851682d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+20:11627:x1874622505122944:12345-192.168.201.9@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787779659.248585:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af6889ecc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779659.248597:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af6889e86 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedafa5 expref: 20 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779659.248603:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af6889ecc lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779659.248644:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af6889e86 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedafa5 expref: 20 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779659.248654:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af6889e86 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedafa5 expref: 20 pid: 5835 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779659.248672:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ec9fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5835:1874622525033088:192.168.201.9@tcp:104: 00000100:00100000:1.0:1787779659.248810:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e87a716180 going to sleep for 11 seconds 00000100:00100000:1.0:1787779659.250243:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ec9fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5835:1874622525033088:192.168.201.9@tcp:104: 00010000:00010000:1.0:1787779659.250280:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af6889ecc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779659.251085:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779659.251144:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505123072 00000100:00100000:3.0:1787779659.251150:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505123072 00010000:00010000:3.0:1787779659.251182:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af6889e86 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedafa5 expref: 21 pid: 5835 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779659.251223:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 80 00000100:00100000:3.0:1787779659.251232:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842fecf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+21:2360:x1874622505123072:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787779659.251247:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787779659.251253:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af6889e86 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedafa5 expref: 21 pid: 5835 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779659.251278:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af6889e86 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedafa5 expref: 21 pid: 5835 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779659.251300:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af6889e86 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedafa5 expref: 21 pid: 5835 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779659.251315:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98e860c40300) 00010000:00010000:3.0:1787779659.251321:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af6889ecc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779659.251343:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af6889ecc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779659.251350:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af6889ecc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779659.251374:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787779659.251415:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842fecf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+20:2360:x1874622505123072:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 186us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779659.251421:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 80 00010000:00010000:1.0:1787779659.251534:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af6889ecc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779659.251539:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af6889ecc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779659.251565:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af6889ecc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779659.251569:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af6889ecc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779659.251573:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af6889ecc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779659.251577:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87a98a600 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:1.0:1787779659.251580:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af6889ecc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779659.251585:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af6889ecc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779659.251592:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98e860c40300) 00010000:00010000:1.0:1787779659.251598:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787779659.251601:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af6889ecc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779659.251605:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af6889ecc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779659.251643:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e851682d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+19:11627:x1874622505122944:12345-192.168.201.9@tcp:55:lhsmtool_posix.0 Request processed in 3104us (3232us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787779659.251648:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 229 00000100:00100000:0.0:1787779659.255773:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779659.256055:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505123200 00000100:00100000:2.0:1787779659.256064:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505123200 00000100:00100000:2.0:1787779659.256153:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 71 00000100:00100000:2.0:1787779659.256163:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e844d29e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+8:2360:x1874622505123200:12345-192.168.201.9@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787779659.256224:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000035afe464/0x9e63ba8af6889ed3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.256246:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000304b3d25/0x9e63ba8af6889eb0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedafc1 expref: 8 pid: 10229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.256286:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787779659.256291:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787779659.256297:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035afe464/0x9e63ba8af6889ed3 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.256338:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000304b3d25/0x9e63ba8af6889eb0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedafc1 expref: 8 pid: 10229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.256355:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000304b3d25/0x9e63ba8af6889eb0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedafc1 expref: 8 pid: 10229 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779659.256370:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ec992c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1874622525033216:192.168.201.9@tcp:104: 00000100:00100000:2.0:1787779659.256499:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e87eb46240 going to sleep for 11 seconds 00000100:00100000:0.0:1787779659.260169:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779659.260627:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505123328 00000100:00100000:3.0:1787779659.260636:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505123328 00010000:00010000:3.0:1787779659.260675:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000304b3d25/0x9e63ba8af6889eb0 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedafc1 expref: 9 pid: 10229 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779659.260812:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 81 00000100:00100000:3.0:1787779659.260820:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e844d29a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+9:2360:x1874622505123328:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787779659.260833:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787779659.260852:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: 00000000304b3d25/0x9e63ba8af6889eb0 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedafc1 expref: 9 pid: 10229 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779659.260863:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000304b3d25/0x9e63ba8af6889eb0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedafc1 expref: 9 pid: 10229 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779659.260893:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=1s v=(1 0) 00010000:00010000:3.0:1787779659.260897:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787779659.260902:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000035afe464/0x9e63ba8af6889ed3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779659.260922:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035afe464/0x9e63ba8af6889ed3 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779659.260941:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787779659.260990:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e844d29a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+9:2360:x1874622505123328:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 170us (831us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779659.260998:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 81 00010000:00010000:2.0:1787779659.261347:0:6680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000304b3d25/0x9e63ba8af6889eb0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedafc1 expref: 8 pid: 10229 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779659.261364:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ec992c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1874622525033216:192.168.201.9@tcp:104: 00010000:00010000:2.0:1787779659.261386:0:6680:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000035afe464/0x9e63ba8af6889ed3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.261396:0:6680:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000035afe464/0x9e63ba8af6889ed3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.261403:0:6680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000035afe464/0x9e63ba8af6889ed3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.261438:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000035afe464/0x9e63ba8af6889ed3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.261446:0:6680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000035afe464/0x9e63ba8af6889ed3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.261454:0:6680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000035afe464/0x9e63ba8af6889ed3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.261461:0:6680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87aa67200 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:2.0:1787779659.261465:0:6680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000035afe464/0x9e63ba8af6889ed3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.261474:0:6680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000035afe464/0x9e63ba8af6889ed3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.261487:0:6680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000035afe464/0x9e63ba8af6889ed3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.261494:0:6680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000035afe464/0x9e63ba8af6889ed3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779659.261573:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e844d29e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+7:2360:x1874622505123200:12345-192.168.201.9@tcp:1:lhsmtool_posix.0 Request processed in 5412us (5812us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779659.261581:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 71 00000100:00100000:0.0:1787779659.263063:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779659.263144:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505123584 00000100:00100000:2.0:1787779659.263152:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505123584 00000100:00100000:2.0:1787779659.263201:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 230 00000100:00100000:2.0:1787779659.263209:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e845c70780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+19:11627:x1874622505123584:12345-192.168.201.9@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787779659.263298:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67600/0x9e63ba8af6889eda lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.263315:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67600/0x9e63ba8af6889eda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.263329:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67600/0x9e63ba8af6889eda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.263540:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af6889ee1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.263548:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98bc00/0x9e63ba8af6889e94 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedafac expref: 20 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.263553:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af6889ee1 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.263579:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98bc00/0x9e63ba8af6889e94 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedafac expref: 20 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.263589:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98bc00/0x9e63ba8af6889e94 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedafac expref: 20 pid: 5836 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779659.263602:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ec992c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5837:1874622525033344:192.168.201.9@tcp:104: 00000100:00100000:2.0:1787779659.263669:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e87eb46240 going to sleep for 11 seconds 00000100:00100000:2.0:1787779659.265035:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ec992c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5837:1874622525033344:192.168.201.9@tcp:104: 00010000:00010000:2.0:1787779659.265061:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af6889ee1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779659.265471:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779659.265642:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505123712 00000100:00100000:3.0:1787779659.265648:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505123712 00010000:00010000:3.0:1787779659.265784:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98bc00/0x9e63ba8af6889e94 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedafac expref: 21 pid: 5836 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779659.265844:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 82 00000100:00100000:3.0:1787779659.265853:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ab352c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+21:2359:x1874622505123712:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787779659.265868:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787779659.265874:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98bc00/0x9e63ba8af6889e94 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedafac expref: 21 pid: 5836 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779659.265884:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98bc00/0x9e63ba8af6889e94 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedafac expref: 21 pid: 5836 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779659.265904:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98bc00/0x9e63ba8af6889e94 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedafac expref: 21 pid: 5836 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779659.265919:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98e860c40300) 00010000:00010000:3.0:1787779659.265931:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af6889ee1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779659.265938:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af6889ee1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779659.265943:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af6889ee1 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779659.265967:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787779659.266008:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ab352c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+20:2359:x1874622505123712:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 157us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779659.266012:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 82 00010000:00010000:1.0:1787779659.266141:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af6889ee1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779659.266149:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af6889ee1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787779659.266340:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:1.0:1787779659.266488:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:1.0:1787779659.266612:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:1.0:1787779659.266673:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ec9fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5837:1874622525033472:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787779659.266732:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779659.266762:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e87a7166c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787779659.266822:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525033472 00000100:00100000:0.0:1787779659.266828:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525033472 00000100:00100000:0.0:1787779659.266870:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787779659.266876:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec9cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5837:x1874622525033472:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787779659.266941:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec9cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5837:x1874622525033472:12345-0@lo:1000:mdt00_002.0 Request processed in 64us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779659.266948:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787779659.267005:0:5837:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:1.0:1787779659.267010:0:5837:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:1.0:1787779659.267023:0:5837:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98e87f6b5a40, transno 4294967321 00000100:00100000:1.0:1787779659.267039:0:5837:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff98e87f6b7840 x1874622525032576/t4294967322(4294967322) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787779675 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779659.267047:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ec9fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5837:1874622525033472:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1787779659.268135:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:1.0:1787779659.268184:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ec9fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5837:1874622525033600:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787779659.268220:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779659.268288:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e87a716180 going to sleep for 11 seconds 00000100:00100000:0.0:1787779659.268317:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525033600 00000100:00100000:0.0:1787779659.268322:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525033600 00000100:00100000:0.0:1787779659.268368:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787779659.268375:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5837:x1874622525033600:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787779659.268536:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ec9fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5837:1874622525033600:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787779659.268555:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5837:x1874622525033600:12345-0@lo:1000:mdt00_002.0 Request processed in 123us (277us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1787779659.268562:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:2.0:1787779659.268564:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af6889ee1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.268572:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af6889ee1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.268580:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af6889ee1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.268586:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87aa66200 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:2.0:1787779659.268591:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af6889ee1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.268599:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af6889ee1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.268615:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98e860c40300) 00010000:00010000:2.0:1787779659.268618:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787779659.268623:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af6889ee1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.268631:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66200/0x9e63ba8af6889ee1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.268653:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98be00/0x9e63ba8af6889e24 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.268665:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98be00/0x9e63ba8af6889e24 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.268669:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98be00/0x9e63ba8af6889e24 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.268672:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87a98be00 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:2.0:1787779659.268674:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98be00/0x9e63ba8af6889e24 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.268678:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98be00/0x9e63ba8af6889e24 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.268683:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98e860c40700) 00010000:00010000:2.0:1787779659.268685:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787779659.268689:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af6889e2b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf90 expref: 23 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.268696:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af6889e2b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf90 expref: 23 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.268702:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af6889e2b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf90 expref: 23 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.268762:0:5837:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af6889e2b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf90 expref: 23 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779659.268773:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ec992c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5837:1874622525033728:192.168.201.9@tcp:105: 00000100:00100000:2.0:1787779659.268849:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e87eb46240 going to sleep for 11 seconds 00000100:00100000:0.0:1787779659.271935:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779659.272022:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505123840 00000100:00100000:1.0:1787779659.272030:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505123840 00000100:00100000:1.0:1787779659.272076:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 61 00000100:00100000:1.0:1787779659.272082:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f6b5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+24:11626:x1874622505123840:12345-192.168.201.9@tcp:49:lfs.0 00000100:00100000:1.0:1787779659.272186:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f6b5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+24:11626:x1874622505123840:12345-192.168.201.9@tcp:49:lfs.0 Request processed in 104us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779659.272194:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 61 00000100:00100000:2.0:1787779659.273586:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ec992c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5837:1874622525033728:192.168.201.9@tcp:105: 00010000:00010000:2.0:1787779659.273616:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98be00/0x9e63ba8af6889e24 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.273626:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98be00/0x9e63ba8af6889e24 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.273655:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67200/0x9e63ba8af6889ee8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.273666:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67200/0x9e63ba8af6889ee8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.273674:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67200/0x9e63ba8af6889ee8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.273681:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67200/0x9e63ba8af6889ee8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.273685:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67200/0x9e63ba8af6889ee8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.273690:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67200/0x9e63ba8af6889ee8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.273693:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87aa67200 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:2.0:1787779659.273696:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67200/0x9e63ba8af6889ee8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.273700:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67200/0x9e63ba8af6889ee8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779659.273794:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779659.273830:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505124096 00000100:00100000:3.0:1787779659.273836:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505124096 00000100:00100000:3.0:1787779659.273884:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 231 00000100:00100000:3.0:1787779659.273893:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec9da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+24:11626:x1874622505124096:12345-192.168.201.9@tcp:58:lfs.0 00010000:00010000:2.0:1787779659.274167:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98e860c40700) 00010000:00010000:2.0:1787779659.274169:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787779659.274174:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67200/0x9e63ba8af6889ee8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.274180:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67200/0x9e63ba8af6889ee8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.274192:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67600/0x9e63ba8af6889eda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.274198:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67600/0x9e63ba8af6889eda lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.274202:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67600/0x9e63ba8af6889eda lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.274206:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87aa67600 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:2.0:1787779659.274208:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67600/0x9e63ba8af6889eda lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.274280:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67600/0x9e63ba8af6889eda lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.274289:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98e860c40700) 00010000:00010000:2.0:1787779659.274292:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787779659.274294:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67600/0x9e63ba8af6889eda lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.274300:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67600/0x9e63ba8af6889eda lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787779659.274429:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1787779659.274501:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e845c70780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+24:11627:x1874622505123584:12345-192.168.201.9@tcp:57:lhsmtool_posix.0 Request processed in 11292us (11440us total) trans 4294967513 rc 0/0 00000100:00100000:2.0:1787779659.274509:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 230 00000020:00080000:2.0:1787779659.274514:0:5837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1787779659.274572:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec9da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+23:11626:x1874622505124096:12345-192.168.201.9@tcp:58:lfs.0 Request processed in 679us (784us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779659.274579:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 231 00000100:00100000:3.0:1787779659.276205:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779659.276352:0:11475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505124352 00000100:00100000:0.0:1787779659.276361:0:11475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505124352 00000100:00100000:0.0:1787779659.276406:0:11475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 62 00000100:00100000:0.0:1787779659.276415:0:11475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e86c759450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+23:11627:x1874622505124352:12345-192.168.201.9@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787779659.277069:0:11475:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787779659.277141:0:11475:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967514 00010000:00010000:0.0:1787779659.277175:0:11475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af6889eef lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779659.277187:0:11475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af6889eef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 11475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779659.277195:0:11475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af6889eef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 11475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779659.277201:0:11475:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af6889eef lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 11475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779659.277211:0:11475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af6889eef lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 11475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779659.277215:0:11475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af6889eef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 11475 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787779659.277408:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787779659.277414:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787779659.277446:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1787779659.277453:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787779659.277555:0:11684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ec9e1c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11684:1874622525033856:192.168.201.9@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787779659.277641:0:11684:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e87a716b40 going to sleep for 11 seconds 00010000:00010000:0.0:1787779659.277686:0:11475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787779659.277761:0:11475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e86c759450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+26:11627:x1874622505124352:12345-192.168.201.9@tcp:35:lhsmtool_posix.0 Request processed in 1347us (1563us total) trans 4294967515 rc 0/0 00000100:00100000:0.0:1787779659.277771:0:11475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 62 00000020:00080000:0.0:1787779659.277776:0:11475:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787779659.278153:0:8500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787779659.278161:0:8500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af6889eef lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 11475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.278169:0:8500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e848f69600 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:2.0:1787779659.278173:0:8500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af6889eef lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 11475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.278180:0:8500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af6889eef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 11475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.278194:0:8500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98e860e78500) 00010000:00010000:2.0:1787779659.278197:0:8500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787779659.278202:0:8500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af6889eef lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.278207:0:8500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af6889eef lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.278224:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779659.278226:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779659.278228:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779659.282568:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779659.282655:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505124480 00000100:00100000:2.0:1787779659.282664:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505124480 00000100:00100000:2.0:1787779659.282749:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 232 00000100:00100000:2.0:1787779659.282760:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec9c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+26:11628:x1874622505124480:12345-192.168.201.9@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787779659.282822:0:8197:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787779659.282925:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec9c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+26:11628:x1874622505124480:12345-192.168.201.9@tcp:53:lhsmtool_posix.0 Request processed in 167us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779659.282933:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 232 00000100:00100000:3.0:1787779659.283456:0:11684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ec9e1c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11684:1874622525033856:192.168.201.9@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787779659.286514:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779659.286798:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505124736 00000100:00100000:3.0:1787779659.286807:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505124736 00000100:00100000:3.0:1787779659.286857:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 233 00000100:00100000:3.0:1787779659.286867:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec9cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+25:11628:x1874622505124736:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787779659.286888:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779659.286925:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af6889ef6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedafc8 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779659.287014:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5800/0x9e63ba8af6889efd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779659.287026:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5800/0x9e63ba8af6889efd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779659.287035:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5800/0x9e63ba8af6889efd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787779659.287042:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787779659.287111:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af6889ef6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedafc8 expref: 28 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779659.287125:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5800/0x9e63ba8af6889efd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedafc8 expref: 27 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779659.287131:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98e860c40700) 00010000:00010000:3.0:1787779659.287133:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787779659.287135:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e8429d5800, rc 0) 00000100:00100000:3.0:1787779659.287185:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec9cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+27:11628:x1874622505124736:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 Request processed in 320us (694us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1787779659.287191:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 233 00000100:00100000:2.0:1787779659.289490:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779659.289555:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505124992 00000100:00100000:3.0:1787779659.289563:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505124992 00000100:00100000:3.0:1787779659.289617:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 234 00000100:00100000:3.0:1787779659.289627:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec992c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+27:11628:x1874622505124992:12345-192.168.201.9@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787779659.289751:0:8197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af6889f0b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779659.289767:0:8197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af6889f0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779659.289781:0:8197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af6889f0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779659.289970:0:8197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af6889f0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779659.289978:0:8197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af6889f0b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779659.289984:0:8197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af6889f0b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779659.289991:0:8197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e8429d5000 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:3.0:1787779659.289995:0:8197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af6889f0b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779659.290003:0:8197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af6889f0b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779659.290015:0:8197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98e860c40700) 00010000:00010000:3.0:1787779659.290018:0:8197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787779659.290021:0:8197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af6889f0b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779659.290027:0:8197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af6889f0b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779659.290168:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec992c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+28:11628:x1874622505124992:12345-192.168.201.9@tcp:57:lhsmtool_posix.0 Request processed in 541us (686us total) trans 4294967517 rc 0/0 00000100:00100000:3.0:1787779659.290177:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 234 00000040:00080000:2.0:1787779659.290343:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787779659.290347:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787779659.290807:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1787779659.290816:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787779659.306952:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779659.306983:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779659.307009:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505125376 00000100:00100000:1.0:1787779659.307016:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505125248 00000100:00100000:0.0:1787779659.307020:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505125376 00000100:00100000:1.0:1787779659.307023:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505125248 00000100:00100000:1.0:1787779659.307078:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 63 00000100:00100000:0.0:1787779659.307090:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 235 00000100:00100000:1.0:1787779659.307092:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec9b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+29:11628:x1874622505125248:12345-192.168.201.9@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787779659.307104:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec9a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+29:11630:x1874622505125376:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:0.0:1787779659.307120:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787779659.307142:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68a00/0x9e63ba8af6889f12 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedafcf expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779659.307200:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af6889f19 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779659.307215:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af6889f19 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779659.307228:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af6889f19 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779659.307246:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af6889f20 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779659.307279:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af6889f20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779659.307287:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af6889f20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779659.307329:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec9b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+31:11628:x1874622505125248:12345-192.168.201.9@tcp:35:lhsmtool_posix.0 Request processed in 241us (342us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1787779659.307339:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 63 00010000:00010000:0.0:1787779659.310580:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af6889f27 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779659.310604:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68800/0x9e63ba8af6889e16 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf89 expref: 30 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779659.310614:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af6889f27 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779659.310656:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68800/0x9e63ba8af6889e16 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf89 expref: 30 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779659.310672:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68800/0x9e63ba8af6889e16 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf89 expref: 30 pid: 8197 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779659.310687:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f6b5a40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5836:1874622525033984:192.168.201.9@tcp:104: 00000100:00100000:0.0:1787779659.311113:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e845f4f180 going to sleep for 11 seconds 00000100:00100000:2.0:1787779659.315945:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779659.317649:0:11475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505125632 00000100:00100000:1.0:1787779659.317662:0:11475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505125632 00000100:00100000:1.0:1787779659.317737:0:11475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 64 00000100:00100000:1.0:1787779659.317748:0:11475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec9b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+31:5599:x1874622505125632:12345-192.168.201.9@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787779659.318001:0:11475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec9b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+32:5599:x1874622505125632:12345-192.168.201.9@tcp:35:ldlm_bl.0 Request processed in 255us (2062us total) trans 4294967519 rc 0/0 00000100:00100000:1.0:1787779659.318009:0:11475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 64 00000100:00100000:2.0:1787779659.319498:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779659.319612:0:11162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505125760 00000100:00100000:1.0:1787779659.319619:0:11162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505125760 00010000:00010000:1.0:1787779659.319650:0:11162:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68800/0x9e63ba8af6889e16 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf89 expref: 32 pid: 8197 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779659.319692:0:11162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 83 00000100:00100000:1.0:1787779659.319702:0:11162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec98780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+32:2360:x1874622505125760:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787779659.320348:0:11162:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787779659.320373:0:11162:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68800/0x9e63ba8af6889e16 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf89 expref: 32 pid: 8197 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.320389:0:11162:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68800/0x9e63ba8af6889e16 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf89 expref: 32 pid: 8197 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.320414:0:11162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98e860c40700) 00010000:00010000:2.0:1787779659.320420:0:11162:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af6889f27 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.320431:0:11162:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af6889f27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.320438:0:11162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af6889f27 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779659.320474:0:11162:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787779659.320529:0:11162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec98780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+32:2360:x1874622505125760:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 828us (1035us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779659.320537:0:11162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 83 00010000:00010000:0.0:1787779659.321651:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68800/0x9e63ba8af6889e16 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf89 expref: 31 pid: 8197 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779659.321669:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f6b5a40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5836:1874622525033984:192.168.201.9@tcp:104: 00010000:00010000:0.0:1787779659.321690:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af6889f27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779659.321708:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af6889f27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779659.321746:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af6889f27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787779659.322549:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1787779659.322612:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787779659.322638:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af6889f27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779659.322652:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af6889f27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779659.322660:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af6889f19 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779659.322665:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af6889f19 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779659.322671:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af6889f19 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779659.322677:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e848f69800 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:0.0:1787779659.322681:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af6889f19 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779659.322687:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af6889f19 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779659.322698:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98e87450a100) 00010000:00010000:0.0:1787779659.322733:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787779659.322740:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af6889f19 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779659.322746:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af6889f19 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779659.322817:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af6889f20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779659.322824:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af6889f20 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779659.322829:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af6889f20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779659.322833:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e848f68200 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:0.0:1787779659.322836:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af6889f20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779659.322841:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af6889f20 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779659.322848:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98e860e78e00) 00010000:00010000:0.0:1787779659.322850:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787779659.322852:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af6889f20 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779659.322857:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68200/0x9e63ba8af6889f20 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779659.322893:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68a00/0x9e63ba8af6889f12 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedafcf expref: 31 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779659.322914:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af6889f27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedafcf expref: 30 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779659.322920:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98e860c40700) 00010000:00010000:0.0:1787779659.322922:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787779659.322924:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e848f68000, rc 0) 00000100:00100000:0.0:1787779659.322981:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec9a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+30:11630:x1874622505125376:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 15882us (16037us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779659.322990:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 235 00010000:00010000:0.0:1787779659.380374:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787779659.863620:0:12504:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787779659.863629:0:12504:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787779659.863674:0:12504:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1787779659.863679:0:12504:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787779660.019499:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779660.019564:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505126016 00000100:00100000:3.0:1787779660.019575:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505126016 00000100:00100000:3.0:1787779660.019655:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 236 00000100:00100000:3.0:1787779660.019666:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f6b5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+30:11654:x1874622505126016:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:3.0:1787779660.019689:0:8197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:2.0:1787779660.019789:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787779660.019962:0:8197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af6889f2e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedafd6 expref: -99 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779660.020050:0:8197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af6889f35 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779660.020062:0:8197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af6889f35 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779660.020070:0:8197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af6889f35 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787779660.020077:0:8197:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787779660.020198:0:8197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af6889f2e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedafd6 expref: 33 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779660.020213:0:8197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af6889f35 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedafd6 expref: 32 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779660.020218:0:8197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98e860c40700) 00010000:00010000:3.0:1787779660.020228:0:8197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787779660.020232:0:8197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e8429d5000, rc 0) 00000100:00100000:3.0:1787779660.020392:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f6b5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+32:11654:x1874622505126016:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 729us (904us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1787779660.020400:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 236 00000100:00100000:3.0:1787779660.029632:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779660.029782:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505126144 00000100:00100000:2.0:1787779660.029792:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505126144 00000100:00100000:2.0:1787779660.030575:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 237 00000100:00100000:2.0:1787779660.030589:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e852b9da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+32:11654:x1874622505126144:12345-192.168.201.9@tcp:54:lfs.0 00010000:00010000:2.0:1787779660.030659:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66600/0x9e63ba8af6889f43 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779660.030677:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66600/0x9e63ba8af6889f43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779660.030689:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66600/0x9e63ba8af6889f43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779660.030744:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66600/0x9e63ba8af6889f43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779660.030752:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66600/0x9e63ba8af6889f43 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779660.030758:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66600/0x9e63ba8af6889f43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779660.030778:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87aa66600 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:2.0:1787779660.030783:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66600/0x9e63ba8af6889f43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779660.030790:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66600/0x9e63ba8af6889f43 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779660.030802:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98e860c40700) 00010000:00010000:2.0:1787779660.030805:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787779660.030810:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66600/0x9e63ba8af6889f43 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779660.030816:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa66600/0x9e63ba8af6889f43 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779660.030892:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e852b9da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+32:11654:x1874622505126144:12345-192.168.201.9@tcp:54:lfs.0 Request processed in 306us (1271us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779660.030901:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 237 00000100:00100000:2.0:1787779660.198845:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779660.199012:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505126272 00000100:00100000:1.0:1787779660.199023:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505126272 00000100:00100000:1.0:1787779660.199085:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 72 00000100:00100000:1.0:1787779660.199097:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec9ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+7:2360:x1874622505126272:12345-192.168.201.9@tcp:101:cat.0 00010000:00010000:1.0:1787779660.199118:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779660.199144:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4063e8c/0x9e63ba8af6889f4a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedafdd expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787779660.199172:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a8f5a49, atime: 0x6a8f5a49, ctime: 0x6a8f5a49, blocks: 0xb 00010000:00010000:1.0:1787779660.199191:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=425s v=(0 0) 00010000:00010000:1.0:1787779660.199196:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787779660.199205:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4063e8c/0x9e63ba8af6889f4a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedafdd expref: 8 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779660.199240:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b4063e8c/0x9e63ba8af6889f4a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedafdd expref: 8 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779660.199267:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87a98bc00, rc 0) 00000100:00100000:1.0:1787779660.199333:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec9ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+8:2360:x1874622505126272:12345-192.168.201.9@tcp:101:cat.0 Request processed in 239us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779660.199340:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 72 00000100:00100000:1.0:1787779660.208674:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779660.208863:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505126400 00000100:00100000:3.0:1787779660.208873:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505126400 00002000:00100000:3.0:1787779660.208927:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff98e87ec9d680 x1874622505126400/t0(0) o3->e225400f-8d32-48a8-ab5e-fe4d3780a20c@192.168.201.9@tcp:71/0 lens 488/0 e 0 to 0 dl 1787779671 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787779660.208938:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98e87ec9d680 with x1874622505126400 ext(0->4095) 00002000:00010000:3.0:1787779660.208944:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98e87ec9d680 00000100:00100000:3.0:1787779660.208980:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 8 00000100:00100000:3.0:1787779660.208990:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec9d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+8:2359:x1874622505126400:12345-192.168.201.9@tcp:3:cat.0 00000100:00100000:3.0:1787779660.209209:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec9d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+8:2359:x1874622505126400:12345-192.168.201.9@tcp:3:cat.0 Request processed in 219us (544us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787779660.209215:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 8 00002000:00100000:3.0:1787779660.209222:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff98e87ec9d680 x1874622505126400/t0(0) o3->e225400f-8d32-48a8-ab5e-fe4d3780a20c@192.168.201.9@tcp:71/0 lens 488/4536 e 0 to 0 dl 1787779671 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787779660.209229:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98e87ec9d680 with x1874622505126400 ext(0->4095) 00002000:00010000:3.0:1787779660.209233:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98e87ec9d680 00010000:00010000:0.0:1787779660.402971:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779660.448193:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779660.448359:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779660.448526:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779660.448625:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505126784 00000100:00100000:1.0:1787779660.448635:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505126784 00000100:00100000:1.0:1787779660.448709:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 175 00000100:00100000:1.0:1787779660.448739:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e852b9e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54e1e60c-3037-4ae3-b045-838eb9e0ad0b+5:2357:x1874622505126784:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:1.0:1787779660.448823:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e852b9e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54e1e60c-3037-4ae3-b045-838eb9e0ad0b+5:2357:x1874622505126784:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 86us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779660.448829:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 175 00000100:00100000:2.0:1787779660.449094:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505126528 00000100:00100000:2.0:1787779660.449098:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505126528 00000100:00100000:2.0:1787779660.449126:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 306 00000100:00100000:2.0:1787779660.449131:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842ebd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+13:2357:x1874622505126528:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:2.0:1787779660.449156:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842ebd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+13:2357:x1874622505126528:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 25us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779660.449160:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 306 00000100:00080000:3.0:1787779660.449381:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787779660.449488:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505126656 00000100:00100000:0.0:1787779660.449494:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505126656 00000100:00100000:0.0:1787779660.449540:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 101 00000100:00100000:0.0:1787779660.449547:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e852b9cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+5:2357:x1874622505126656:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:0.0:1787779660.449587:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e852b9cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+5:2357:x1874622505126656:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 41us (1405us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779660.449594:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 101 00000100:00080000:3.0:1787779660.449861:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:3.0:1787779661.370580:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787779661.370591:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787779661.370624:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1787779661.370632:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787779661.431945:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787779662.260292:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787779662.260339:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ec9d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622525034112:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787779662.260423:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779662.260632:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525034112 00000100:00100000:0.0:1787779662.260641:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525034112 00000100:00100000:0.0:1787779662.260735:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787779662.260745:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec9a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1874622525034112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787779662.260781:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787779662.260824:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec9a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1874622525034112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779662.260840:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:2.0:1787779662.260950:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787779662.260985:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ec9d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622525034112:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787779662.451080:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779663.286939:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ec9c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622525034624:0@lo:400:kworker.0 00000100:00100000:1.0:1787779663.287019:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779663.287083:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787779663.287091:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ec9f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874622525034496:0@lo:400:kworker.0 00000100:00100000:1.0:1787779663.287121:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779663.287157:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525034624 00000100:00100000:1.0:1787779663.287165:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525034624 00000100:00100000:1.0:1787779663.287225:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787779663.287235:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec9e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3307:x1874622525034624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779663.287303:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec9e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3307:x1874622525034624:12345-0@lo:400:kworker.0 Request processed in 70us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779663.287311:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787779663.287341:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525034496 00000100:00100000:1.0:1787779663.287345:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525034496 00000100:00100000:1.0:1787779663.287388:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1787779663.287396:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec9de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874622525034496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779663.287427:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec9de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874622525034496:12345-0@lo:400:kworker.0 Request processed in 33us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779663.287434:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1787779663.287473:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ec9f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874622525034496:0@lo:400:kworker.0 00000100:00100000:1.0:1787779663.287485:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ec9c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622525034624:0@lo:400:kworker.0 00000100:00100000:2.0:1787779663.289370:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ec9f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874622525034368:0@lo:400:kworker.0 00000100:00100000:2.0:1787779663.289442:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779663.289483:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ec9ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874622525034880:0@lo:400:kworker.0 00000100:00100000:2.0:1787779663.289509:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779663.289552:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787779663.289558:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ec9e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c28aae66-2825-42c5-8f52-61f687e868c9:3305:1874622525034240:0@lo:400:kworker.0 00000100:00100000:2.0:1787779663.289585:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779663.289609:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ec9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874622525034752:0@lo:400:kworker.0 00000100:00100000:2.0:1787779663.289632:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779663.289667:0:10229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525034880 00000100:00100000:2.0:1787779663.289675:0:10229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525034880 00000100:00100000:2.0:1787779663.289766:0:10229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787779663.289777:0:10229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec98b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3305:x1874622525034880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779663.289829:0:10229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec98b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3305:x1874622525034880:12345-0@lo:400:kworker.0 Request processed in 55us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779663.289836:0:10229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:2.0:1787779663.289855:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787779663.289860:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787779663.289870:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525034368 00000100:00100000:2.0:1787779663.289873:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525034368 00000100:00100000:2.0:1787779663.289894:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525034752 00000100:00100000:2.0:1787779663.289897:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525034752 00000100:00100000:2.0:1787779663.289917:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1787779663.289938:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec9bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874622525034368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779663.289969:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec9bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874622525034368:12345-0@lo:400:kworker.0 Request processed in 32us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779663.289976:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1787779663.289989:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787779663.289996:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874622525034752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779663.290022:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874622525034752:12345-0@lo:400:kworker.0 Request processed in 27us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779663.290028:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787779663.290046:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525034240 00000100:00100000:2.0:1787779663.290050:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525034240 00000100:00100000:2.0:1787779663.290073:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1787779663.290079:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+19:3305:x1874622525034240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779663.290110:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c28aae66-2825-42c5-8f52-61f687e868c9+19:3305:x1874622525034240:12345-0@lo:400:kworker.0 Request processed in 31us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779663.290116:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00080000:2.0:1787779663.290156:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787779663.290183:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ec9e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c28aae66-2825-42c5-8f52-61f687e868c9:3305:1874622525034240:0@lo:400:kworker.0 00000100:00100000:2.0:1787779663.290212:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ec9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874622525034752:0@lo:400:kworker.0 00000100:00100000:2.0:1787779663.290222:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ec9f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874622525034368:0@lo:400:kworker.0 00000100:00100000:2.0:1787779663.290231:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ec9ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874622525034880:0@lo:400:kworker.0 00000001:00080000:0.0:1787779663.325765:0:7634:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00010000:00010000:0.0:1787779663.476056:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787779663.795221:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ec9c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622525035008:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787779663.795310:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779663.795558:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525035008 00000100:00100000:1.0:1787779663.795566:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525035008 00000100:00100000:1.0:1787779663.795621:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787779663.795630:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec99a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622525035008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787779663.795666:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787779663.795738:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec99a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622525035008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779663.795745:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787779663.795779:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1787779663.795784:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98e852b9e1c0, transno 4294967310 00000100:00100000:1.0:1787779663.795815:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ec9c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622525035008:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1787779664.386773:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:2.0:1787779664.386803:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:3.0:1787779664.461085:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967515 is committed 00000020:00080000:3.0:1787779664.461117:0:5857:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000001:00080000:3.0:1787779664.461141:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:3.0:1787779664.461161:0:5857:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98e87a7166c0 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1787779664.461166:0:5857:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98e87f500700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98e87a716cc0 00000020:00080000:3.0:1787779664.461179:0:5857:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98e87f500a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98e87fd37000 00000001:00080000:3.0:1787779664.461197:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:0.0:1787779664.461249:0:5868:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:0.0:1787779664.461464:0:5868:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:2.0:1787779664.499235:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779665.522908:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779665.570080:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779665.570119:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779665.570172:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779665.570200:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779665.570226:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779665.570256:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505127424 00000100:00100000:1.0:1787779665.570266:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505127424 00000100:00100000:1.0:1787779665.570336:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505127040 00000100:00100000:1.0:1787779665.570339:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505127040 00000100:00100000:1.0:1787779665.570365:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 179 00000100:00100000:1.0:1787779665.570375:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec9f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54e1e60c-3037-4ae3-b045-838eb9e0ad0b+5:2357:x1874622505127424:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:1.0:1787779665.570447:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec9f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54e1e60c-3037-4ae3-b045-838eb9e0ad0b+5:2357:x1874622505127424:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 73us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779665.570455:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 179 00000100:00100000:1.0:1787779665.570472:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 180 00000100:00100000:1.0:1787779665.570479:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec9ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+19:2357:x1874622505127040:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:1.0:1787779665.570513:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec9ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+19:2357:x1874622505127040:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 36us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779665.570520:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 180 00000100:00100000:1.0:1787779665.570543:0:10229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505127168 00000100:00100000:1.0:1787779665.570547:0:10229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505127168 00000100:00100000:1.0:1787779665.570570:0:10229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505127296 00000100:00100000:1.0:1787779665.570574:0:10229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505127296 00000100:00100000:1.0:1787779665.570595:0:10229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 104 00000100:00100000:1.0:1787779665.570602:0:10229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec9c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+7:2357:x1874622505127168:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:1.0:1787779665.570629:0:10229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec9c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+7:2357:x1874622505127168:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 28us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779665.570636:0:10229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 104 00000100:00100000:1.0:1787779665.570657:0:10229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 105 00000100:00100000:1.0:1787779665.570664:0:10229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec9f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+5:2357:x1874622505127296:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:1.0:1787779665.570690:0:10229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec9f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e225400f-8d32-48a8-ab5e-fe4d3780a20c+5:2357:x1874622505127296:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 26us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779665.570695:0:10229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 105 00000100:00080000:1.0:1787779665.570895:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787779665.570900:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787779665.570902:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787779665.571893:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505126912 00000100:00100000:2.0:1787779665.571903:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505126912 00000100:00100000:2.0:1787779665.571955:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 308 00000100:00100000:2.0:1787779665.571964:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+13:2357:x1874622505126912:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:2.0:1787779665.572036:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+13:2357:x1874622505126912:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 74us (1967us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779665.572044:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 308 00000100:00100000:1.0:1787779666.056600:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779666.056702:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505127552 00000100:00100000:2.0:1787779666.056745:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505127552 00000100:00100000:2.0:1787779666.056811:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 238 00000100:00100000:2.0:1787779666.056822:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+19:11315:x1874622505127552:12345-192.168.201.9@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1787779666.056936:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+19:11315:x1874622505127552:12345-192.168.201.9@tcp:60:lhsmtool_posix.0 Request processed in 117us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779666.056944:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 238 00000100:00100000:1.0:1787779666.059482:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779666.059559:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505127808 00000100:00100000:3.0:1787779666.059569:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505127808 00000100:00100000:3.0:1787779666.059620:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 65 00000100:00100000:3.0:1787779666.059629:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec9e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+19:11315:x1874622505127808:12345-192.168.201.9@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787779666.060155:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec9e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+20:11315:x1874622505127808:12345-192.168.201.9@tcp:35:lhsmtool_posix.0 Request processed in 526us (680us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1787779666.060165:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 65 00000100:00100000:3.0:1787779666.262006:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779666.262245:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505127936 00000100:00100000:1.0:1787779666.262256:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505127936 00000100:00100000:1.0:1787779666.262320:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 239 00000100:00100000:1.0:1787779666.262332:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e74353d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54e1e60c-3037-4ae3-b045-838eb9e0ad0b+5:12106:x1874622505127936:12345-192.168.201.9@tcp:101:lsof.0 00010000:00010000:1.0:1787779666.262353:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779666.262375:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af6889f51 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedafe4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779666.262442:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af6889f58 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779666.262456:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af6889f58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779666.262468:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af6889f58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787779666.262678:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787779666.262682:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1787779666.262804:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af6889f58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779666.262831:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af6889f51 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedafe4 expref: 7 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779666.262849:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af6889f58 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedafe4 expref: 6 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779666.262855:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e87450a400) 00010000:00010000:1.0:1787779666.262857:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787779666.262859:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87a98aa00, rc 0) 00000100:00100000:1.0:1787779666.262913:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e74353d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54e1e60c-3037-4ae3-b045-838eb9e0ad0b+6:12106:x1874622505127936:12345-192.168.201.9@tcp:101:lsof.0 Request processed in 584us (920us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779666.262921:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 239 00010000:00010000:0.0:1787779666.548186:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779667.378964:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ec9d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622525035136:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787779667.379049:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779667.379291:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525035136 00000100:00100000:1.0:1787779667.379300:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525035136 00000100:00100000:1.0:1787779667.379373:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787779667.379384:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e881ddad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622525035136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787779667.379420:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787779667.379472:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e881ddad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622525035136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779667.379479:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:3.0:1787779667.379540:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787779667.380190:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:0.0:1787779667.380199:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98e87f6b7840, transno 4294967322 00000004:00080000:0.0:1787779667.380219:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:0.0:1787779667.380248:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ec9d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622525035136:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787779667.571010:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779668.404140:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e74353d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c28aae66-2825-42c5-8f52-61f687e868c9:3304:1874622525035264:0@lo:400:kworker.0 00000100:00100000:0.0:1787779668.404224:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779668.404295:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e74353c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874622525035776:0@lo:400:kworker.0 00000100:00100000:0.0:1787779668.404324:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779668.404352:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787779668.404358:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e74353e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874622525035392:0@lo:400:kworker.0 00000100:00100000:0.0:1787779668.404380:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779668.404396:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e74353c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874622525035904:0@lo:400:kworker.0 00000100:00100000:0.0:1787779668.404438:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779668.404468:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e74353f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622525035648:0@lo:400:kworker.0 00000100:00100000:0.0:1787779668.404495:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779668.404526:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787779668.404532:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e74353f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874622525035520:0@lo:400:kworker.0 00000100:00100000:0.0:1787779668.404555:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779668.404580:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525035264 00000100:00100000:0.0:1787779668.404587:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525035264 00000100:00100000:0.0:1787779668.404628:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1787779668.404636:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+19:3304:x1874622525035264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779668.404683:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+19:3304:x1874622525035264:12345-0@lo:400:kworker.0 Request processed in 47us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779668.404690:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1787779668.404742:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525035904 00000100:00100000:0.0:1787779668.404746:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525035904 00000100:00100000:0.0:1787779668.404780:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525035648 00000100:00100000:0.0:1787779668.404783:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525035648 00000100:00100000:0.0:1787779668.404801:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787779668.404808:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87fdd30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874622525035904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779668.404841:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87fdd30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874622525035904:12345-0@lo:400:kworker.0 Request processed in 34us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779668.404847:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787779668.404860:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787779668.404866:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87fdd0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622525035648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779668.404896:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87fdd0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622525035648:12345-0@lo:400:kworker.0 Request processed in 31us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779668.404902:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:0.0:1787779668.404919:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787779668.404947:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e74353f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622525035648:0@lo:400:kworker.0 00000100:00100000:0.0:1787779668.404969:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525035776 00000100:00100000:0.0:1787779668.404977:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525035776 00000100:00100000:0.0:1787779668.405003:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525035392 00000100:00100000:0.0:1787779668.405005:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525035392 00000100:00100000:0.0:1787779668.405013:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525035520 00000100:00100000:0.0:1787779668.405015:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525035520 00000100:00100000:0.0:1787779668.405026:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1787779668.405031:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e881ddb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874622525035776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779668.405059:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e881ddb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874622525035776:12345-0@lo:400:kworker.0 Request processed in 28us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779668.405064:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1787779668.405074:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1787779668.405080:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f5392c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874622525035392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779668.405118:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f5392c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874622525035392:12345-0@lo:400:kworker.0 Request processed in 37us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779668.405124:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1787779668.405134:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1787779668.405140:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87fdd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874622525035520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779668.405169:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87fdd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874622525035520:12345-0@lo:400:kworker.0 Request processed in 29us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779668.405174:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00080000:0.0:1787779668.405187:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787779668.405204:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e74353f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874622525035520:0@lo:400:kworker.0 00000100:00100000:0.0:1787779668.405227:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e74353e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874622525035392:0@lo:400:kworker.0 00000100:00100000:0.0:1787779668.405237:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e74353c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874622525035904:0@lo:400:kworker.0 00000100:00100000:0.0:1787779668.405245:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e74353d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c28aae66-2825-42c5-8f52-61f687e868c9:3304:1874622525035264:0@lo:400:kworker.0 00000100:00100000:0.0:1787779668.405266:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e74353c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874622525035776:0@lo:400:kworker.0 00010000:00010000:0.0:1787779668.595296:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779668.915257:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787779668.915282:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ec9e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622525036032:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787779668.915355:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779668.915486:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525036032 00000100:00100000:1.0:1787779668.915493:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525036032 00000100:00100000:1.0:1787779668.915545:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787779668.915554:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e74353ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622525036032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787779668.915587:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787779668.915659:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e74353ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622525036032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779668.915666:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787779668.915828:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ec9e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622525036032:0@lo:13:osp-pre-1-0.0 00000020:00080000:3.0:1787779669.574704:0:5857:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:0.0:1787779669.574766:0:5868:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:0.0:1787779669.574777:0:5868:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000001:00080000:3.0:1787779669.575001:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00010000:00010000:0.0:1787779669.624817:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787779670.260173:0:12711:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 17:27:48 (1787779668) 00010000:00010000:1.0:1787779670.644978:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787779670.687210:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779670.687259:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779670.687301:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779670.687401:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505128320 00000100:00100000:0.0:1787779670.687413:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505128320 00000100:00100000:0.0:1787779670.687492:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 108 00000100:00100000:0.0:1787779670.687504:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec99680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+7:2358:x1874622505128320:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:0.0:1787779670.687583:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec99680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+7:2358:x1874622505128320:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 83us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779670.687592:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 108 00000100:00100000:1.0:1787779670.687664:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505128192 00000100:00100000:1.0:1787779670.687669:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505128192 00000100:00100000:1.0:1787779670.687747:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 184 00000100:00100000:1.0:1787779670.687755:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+19:2358:x1874622505128192:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:1.0:1787779670.687793:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+19:2358:x1874622505128192:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 40us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779670.687800:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 184 00000100:00080000:2.0:1787779670.688057:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787779670.688071:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787779670.688178:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505128064 00000100:00100000:3.0:1787779670.688184:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505128064 00000100:00100000:3.0:1787779670.688225:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 310 00000100:00100000:3.0:1787779670.688234:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+13:2358:x1874622505128064:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:3.0:1787779670.688268:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+13:2358:x1874622505128064:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 36us (1074us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779670.688277:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 310 00000100:00100000:3.0:1787779670.690383:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779670.690482:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779670.690582:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505128576 00000100:00100000:0.0:1787779670.690590:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505128576 00000100:00100000:0.0:1787779670.690665:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 185 00000100:00100000:0.0:1787779670.690674:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e74353de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54e1e60c-3037-4ae3-b045-838eb9e0ad0b+6:2357:x1874622505128576:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:0.0:1787779670.690784:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e74353de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54e1e60c-3037-4ae3-b045-838eb9e0ad0b+6:2357:x1874622505128576:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 111us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779670.690791:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 185 00000100:00080000:2.0:1787779670.692465:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787779670.695859:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505128448 00000100:00100000:1.0:1787779670.695875:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505128448 00000100:00100000:1.0:1787779670.695969:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 109 00000100:00100000:1.0:1787779670.695980:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e74353e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+5:2357:x1874622505128448:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:1.0:1787779670.696083:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e74353e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+5:2357:x1874622505128448:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 104us (5711us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779670.696091:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 109 00000100:00080000:2.0:1787779670.696271:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:3.0:1787779671.604028:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787779671.604039:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787779671.615244:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1787779671.615258:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787779671.667907:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779672.501565:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787779672.501589:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87fdd2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622525036160:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787779672.501660:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779672.501755:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525036160 00000100:00100000:0.0:1787779672.501762:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525036160 00000100:00100000:0.0:1787779672.501819:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787779672.501841:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87fdd2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622525036160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787779672.501888:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787779672.501945:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87fdd2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622525036160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779672.501953:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:0.0:1787779672.501986:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787779672.502271:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87fdd2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622525036160:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787779672.703652:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779673.523369:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87fdd3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874622525036416:0@lo:400:kworker.0 00000100:00100000:2.0:1787779673.523583:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87fdd1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c28aae66-2825-42c5-8f52-61f687e868c9:3304:1874622525036288:0@lo:400:kworker.0 00000100:00100000:2.0:1787779673.523627:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779673.523657:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87fdd0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874622525036544:0@lo:400:kworker.0 00000100:00100000:2.0:1787779673.523701:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87fdd1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874622525036800:0@lo:400:kworker.0 00000100:00100000:3.0:1787779673.523708:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779673.523764:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779673.523767:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787779673.523777:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87fdd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622525036672:0@lo:400:kworker.0 00000100:00100000:2.0:1787779673.523808:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525036288 00000100:00100000:2.0:1787779673.523815:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525036288 00000100:00100000:3.0:1787779673.523820:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779673.523859:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525036544 00000100:00100000:2.0:1787779673.523867:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1787779673.523878:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+19:3304:x1874622525036288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779673.523932:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c28aae66-2825-42c5-8f52-61f687e868c9+19:3304:x1874622525036288:12345-0@lo:400:kworker.0 Request processed in 56us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779673.523940:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1787779673.523969:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525036800 00000100:00100000:2.0:1787779673.523972:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525036800 00000100:00100000:2.0:1787779673.524028:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1787779673.524035:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec9a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874622525036800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779673.524067:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec9a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874622525036800:12345-0@lo:400:kworker.0 Request processed in 33us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779673.524073:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00080000:2.0:1787779673.524088:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787779673.524105:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525036544 00000100:00100000:2.0:1787779673.524116:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87fdd1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c28aae66-2825-42c5-8f52-61f687e868c9:3304:1874622525036288:0@lo:400:kworker.0 00000100:00100000:2.0:1787779673.524133:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87fdd1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874622525036800:0@lo:400:kworker.0 00000100:00100000:3.0:1787779673.524150:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00080000:2.0:1787779673.524156:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787779673.524162:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e74353fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874622525036544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779673.524187:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525036672 00000100:00100000:2.0:1787779673.524191:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525036672 00000100:00100000:2.0:1787779673.524215:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787779673.524221:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e74353cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622525036672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779673.524255:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e74353cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622525036672:12345-0@lo:400:kworker.0 Request processed in 34us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779673.524273:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787779673.524298:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87fdd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622525036672:0@lo:400:kworker.0 00000100:00100000:3.0:1787779673.524332:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e74353fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874622525036544:12345-0@lo:400:kworker.0 Request processed in 172us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779673.524340:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1787779673.524353:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87fdd0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874622525036544:0@lo:400:kworker.0 00000100:00100000:0.0:1787779673.525163:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779673.525210:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87fdd21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874622525036928:0@lo:400:kworker.0 00000100:00100000:0.0:1787779673.525244:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779673.525316:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525036416 00000100:00100000:2.0:1787779673.525321:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525036416 00000100:00100000:2.0:1787779673.525357:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1787779673.525365:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87fdd03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874622525036416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779673.525405:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87fdd03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874622525036416:12345-0@lo:400:kworker.0 Request processed in 41us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779673.525412:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1787779673.528177:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87fdd3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874622525036416:0@lo:400:kworker.0 00000100:00100000:1.0:1787779673.532973:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525036928 00000100:00100000:1.0:1787779673.532990:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525036928 00000100:00100000:1.0:1787779673.533210:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787779673.533221:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87fdd0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874622525036928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779673.533320:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87fdd0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874622525036928:12345-0@lo:400:kworker.0 Request processed in 101us (8074us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779673.533328:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787779673.533386:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87fdd21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874622525036928:0@lo:400:kworker.0 00000100:00080000:0.0:1787779673.533557:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787779673.715475:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779674.035033:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787779674.035059:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ec9fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622525037056:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787779674.035132:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779674.035312:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525037056 00000100:00100000:1.0:1787779674.035321:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525037056 00000100:00100000:1.0:1787779674.035379:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787779674.035389:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e74353f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622525037056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787779674.035434:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787779674.035481:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e74353f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622525037056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779674.035488:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787779674.035805:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ec9fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622525037056:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787779674.526651:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779674.526765:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505128832 00000100:00100000:0.0:1787779674.526775:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505128832 00000100:00100000:0.0:1787779674.526845:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 66 00000100:00100000:0.0:1787779674.526856:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e74353da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+19:12328:x1874622505128832:12345-192.168.201.9@tcp:35:umount.0 00000100:00100000:0.0:1787779674.527365:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e74353da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+20:12328:x1874622505128832:12345-192.168.201.9@tcp:35:umount.0 Request processed in 510us (723us total) trans 4294967522 rc 0/0 00000100:00100000:0.0:1787779674.527374:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 66 00000100:00080000:2.0:1787779674.527606:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787779674.530525:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779674.530626:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505129088 00000100:00100000:2.0:1787779674.530638:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505129088 00000100:00100000:1.0:1787779674.530867:0:11475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 67 00000100:00100000:1.0:1787779674.530880:0:11475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87fdd3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+20:12328:x1874622505129088:12345-192.168.201.9@tcp:35:umount.0 00000100:00100000:1.0:1787779674.531309:0:11475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87fdd3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+21:12328:x1874622505129088:12345-192.168.201.9@tcp:35:umount.0 Request processed in 431us (792us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1787779674.531318:0:11475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 67 00000100:00100000:1.0:1787779674.538319:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779674.538521:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505129344 00000100:00100000:0.0:1787779674.538532:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505129344 00000100:00100000:0.0:1787779674.538587:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 68 00000100:00100000:0.0:1787779674.538597:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e86c75a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+21:12328:x1874622505129344:12345-192.168.201.9@tcp:35:umount.0 00000100:00100000:0.0:1787779674.539319:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e86c75a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+22:12328:x1874622505129344:12345-192.168.201.9@tcp:35:umount.0 Request processed in 720us (1005us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1787779674.539336:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 68 00000100:00100000:3.0:1787779674.542044:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779674.542134:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505129600 00000100:00100000:2.0:1787779674.542143:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505129600 00000100:00100000:2.0:1787779674.542193:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 69 00000100:00100000:2.0:1787779674.542201:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e74353e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+22:12328:x1874622505129600:12345-192.168.201.9@tcp:35:umount.0 00000100:00100000:2.0:1787779674.542533:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e74353e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+23:12328:x1874622505129600:12345-192.168.201.9@tcp:35:umount.0 Request processed in 332us (496us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1787779674.542542:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 69 00000100:00100000:3.0:1787779674.546874:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779674.546922:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779674.546963:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779674.547192:0:11162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505129728 00000100:00100000:1.0:1787779674.547203:0:11162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505129728 00000100:00100000:1.0:1787779674.547272:0:11162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505129984 00000100:00100000:1.0:1787779674.547275:0:11162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505129984 00000100:00100000:1.0:1787779674.547287:0:11162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505129856 00000100:00100000:1.0:1787779674.547289:0:11162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505129856 00000100:00100000:1.0:1787779674.547303:0:11162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 18 00000100:00100000:1.0:1787779674.547312:0:11162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e74353c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+15:2357:x1874622505129728:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787779674.547330:0:11162:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787779674.547354:0:11162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e848f69c00/0x9e63ba8af6888fd0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedab6f expref: 15 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779674.547390:0:11162:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787779674.547444:0:11162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e74353c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+14:2357:x1874622505129728:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 134us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779674.547451:0:11162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 18 00000100:00100000:1.0:1787779674.547475:0:11162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 19 00000100:00100000:1.0:1787779674.547481:0:11162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e74353da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+13:2357:x1874622505129984:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787779674.547488:0:11162:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787779674.547496:0:11162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e87aa67c00/0x9e63ba8af68891ba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac3a expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779674.547505:0:11162:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787779674.547521:0:11162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e74353da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+12:2357:x1874622505129984:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 41us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779674.547527:0:11162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 19 00000100:00100000:1.0:1787779674.547538:0:11162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 20 00000100:00100000:1.0:1787779674.547543:0:11162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e847d94050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+11:2357:x1874622505129856:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787779674.547550:0:11162:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787779674.547563:0:11162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e8429d4c00/0x9e63ba8af6888f36 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedab37 expref: 11 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779674.547574:0:11162:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787779674.547593:0:11162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e847d94050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+10:2357:x1874622505129856:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 49us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779674.547599:0:11162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 20 00000100:00100000:0.0:1787779674.555175:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779674.555338:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505130112 00000100:00100000:3.0:1787779674.555349:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505130112 00000100:00100000:3.0:1787779674.555417:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 73 00000100:00100000:3.0:1787779674.555426:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87fdd3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+5:2356:x1874622505130112:12345-192.168.201.9@tcp:9:umount.0 00000020:00000080:3.0:1787779674.555454:0:6681:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9e63ba8af68892a8 00000100:00080000:3.0:1787779674.555463:0:6681:0:(import.c:65:import_set_state_nolock()) ffff98e881da1000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787779674.555496:0:6681:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1787779674.555789:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87fdd3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e225400f-8d32-48a8-ab5e-fe4d3780a20c+2:2356:x1874622505130112:12345-192.168.201.9@tcp:9:umount.0 Request processed in 363us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779674.555797:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 73 00000100:00080000:0.0:1787779674.555977:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787779674.556019:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779674.568259:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779674.568810:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505130496 00000100:00100000:0.0:1787779674.568821:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505130496 00000100:00100000:0.0:1787779674.568919:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 74 00000100:00100000:0.0:1787779674.568931:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e74353c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+7:2356:x1874622505130496:12345-192.168.201.9@tcp:9:umount.0 00000020:00000080:0.0:1787779674.568968:0:6680:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9e63ba8af6889510 00000020:00010000:0.0:1787779674.568977:0:6680:0:(genops.c:1921:obd_stale_export_put()) Put export ffff98e881da2800: total 0 00000100:00080000:0.0:1787779674.568982:0:6680:0:(import.c:65:import_set_state_nolock()) ffff98e881da5800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787779674.569038:0:6680:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1787779674.569308:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e74353c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e225400f-8d32-48a8-ab5e-fe4d3780a20c+5:2356:x1874622505130496:12345-192.168.201.9@tcp:9:umount.0 Request processed in 379us (1060us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779674.569317:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 74 00000020:00010000:0.0:1787779674.569336:0:5824:0:(genops.c:1907:obd_stale_export_get()) Get export ffff98e881da2800: total 0 00010000:00010000:0.0:1787779674.569356:0:5824:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff98e881da2800, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1787779674.569410:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000041391af6/0x9e63ba8af68898ac lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae0f expref: 4 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779674.569445:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4063e8c/0x9e63ba8af6889f4a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedafdd expref: 3 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779674.569459:0:5824:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff98e881da2800, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1787779674.569470:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779674.569472:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779674.569488:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787779674.569633:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1787779674.596239:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000001:00080000:3.0:1787779674.596267:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000100:00100000:3.0:1787779674.599673:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779674.604735:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505131520 00000100:00100000:1.0:1787779674.604772:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505131520 00000100:00100000:1.0:1787779674.604851:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 240 00000100:00100000:1.0:1787779674.604862:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e74353d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+19:2356:x1874622505131520:12345-192.168.201.9@tcp:39:umount.0 00000020:00000080:1.0:1787779674.604900:0:5837:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9e63ba8af6888f44 00000020:00010000:1.0:1787779674.604922:0:5837:0:(genops.c:1921:obd_stale_export_put()) Put export ffff98e881a49800: total 0 00000100:00080000:1.0:1787779674.604928:0:5837:0:(import.c:65:import_set_state_nolock()) ffff98e881a4e000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787779674.604970:0:5837:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:1.0:1787779674.605518:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e74353d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e225400f-8d32-48a8-ab5e-fe4d3780a20c+18:2356:x1874622505131520:12345-192.168.201.9@tcp:39:umount.0 Request processed in 656us (5852us total) trans 4294967526 rc 0/0 00000100:00100000:1.0:1787779674.605528:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 240 00000020:00010000:2.0:1787779674.605664:0:8500:0:(genops.c:1907:obd_stale_export_get()) Get export ffff98e881a49800: total 0 00010000:00010000:2.0:1787779674.605709:0:8500:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff98e881a49800, canceled 0 locks, left on hash table 14. 00010000:00010000:2.0:1787779674.605759:0:8500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98e87450ad00) 00010000:00010000:2.0:1787779674.605764:0:8500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787779674.605780:0:8500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68e00/0x9e63ba8af688986d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedadfa expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779674.605800:0:8500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98e860c40700) 00010000:00010000:2.0:1787779674.605803:0:8500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787779674.605807:0:8500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5800/0x9e63ba8af6889efd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedafc8 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779674.605821:0:8500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e87450a400) 00010000:00010000:2.0:1787779674.605823:0:8500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787779674.605827:0:8500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5200/0x9e63ba8af688990e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae2b expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779674.605839:0:8500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98e87450a200) 00010000:00010000:2.0:1787779674.605841:0:8500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787779674.605845:0:8500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69e00/0x9e63ba8af688956b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedad36 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779674.605855:0:8500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98e860c40200) 00010000:00010000:2.0:1787779674.605857:0:8500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787779674.605860:0:8500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a000/0x9e63ba8af688920e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac48 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779674.605877:0:8500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98e87450ad00) 00010000:00010000:2.0:1787779674.605880:0:8500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787779674.605883:0:8500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b800/0x9e63ba8af6889897 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae08 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779674.605894:0:8500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98e87450a100) 00010000:00010000:2.0:1787779674.605902:0:8500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787779674.605907:0:8500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5400/0x9e63ba8af6889c09 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf04 expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779674.605919:0:8500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98e860c40700) 00010000:00010000:2.0:1787779674.605921:0:8500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787779674.605925:0:8500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5000/0x9e63ba8af6889f35 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedafd6 expref: 10 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779674.605949:0:8500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98e860c40700) 00010000:00010000:2.0:1787779674.605951:0:8500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787779674.605955:0:8500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af6889e2b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaf90 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779674.605966:0:8500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98e860c40700) 00010000:00010000:2.0:1787779674.605968:0:8500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787779674.605972:0:8500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af6889f27 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedafcf expref: 8 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779674.605985:0:8500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98e87450a100) 00010000:00010000:2.0:1787779674.605987:0:8500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787779674.605999:0:8500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4000/0x9e63ba8af688992a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedae32 expref: 7 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779674.606016:0:8500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98e87450ad00) 00010000:00010000:2.0:1787779674.606019:0:8500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787779674.606023:0:8500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af688978d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedadc2 expref: 6 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779674.606052:0:8500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98e87450a200) 00010000:00010000:2.0:1787779674.606054:0:8500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787779674.606058:0:8500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5600/0x9e63ba8af688927e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac64 expref: 5 pid: 8197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779674.606074:0:8500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98e84927fc00) 00010000:00010000:2.0:1787779674.606077:0:8500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787779674.606080:0:8500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87aa67800/0x9e63ba8af688922a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac4f expref: 4 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779674.606101:0:8500:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff98e881a49800, canceled 14 locks, left on hash table 0. 00010000:00010000:2.0:1787779674.606115:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779674.606117:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779674.606118:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779674.740915:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779675.762942:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779675.809845:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779675.809917:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779675.810043:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505131776 00000100:00100000:3.0:1787779675.810055:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505131776 00000100:00100000:3.0:1787779675.810141:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 189 00000100:00100000:3.0:1787779675.810153:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87fdd1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54e1e60c-3037-4ae3-b045-838eb9e0ad0b+6:2360:x1874622505131776:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:3.0:1787779675.810267:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87fdd1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54e1e60c-3037-4ae3-b045-838eb9e0ad0b+6:2360:x1874622505131776:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 117us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779675.810276:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 189 00000100:00100000:2.0:1787779675.810797:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505131648 00000100:00100000:2.0:1787779675.810802:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505131648 00000100:00100000:2.0:1787779675.810834:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 312 00000100:00100000:2.0:1787779675.810840:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+10:2360:x1874622505131648:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:2.0:1787779675.810907:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+10:2360:x1874622505131648:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 68us (1074us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779675.810912:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 312 00000100:00080000:0.0:1787779675.811024:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787779676.788122:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779676.957591:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779676.957625:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779676.957701:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779676.957769:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505131904 00000100:00100000:3.0:1787779676.957777:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505131904 00000100:00100000:3.0:1787779676.957826:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505132032 00000100:00100000:3.0:1787779676.957828:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505132032 00000100:00100000:3.0:1787779676.957837:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505132160 00000100:00100000:3.0:1787779676.957839:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505132160 00000100:00100000:3.0:1787779676.957853:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 21 00000100:00100000:3.0:1787779676.957861:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e74353c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+12:2360:x1874622505131904:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787779676.957876:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787779676.957899:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e848f68c00/0x9e63ba8af6889016 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedab84 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779676.957920:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787779676.957987:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e74353c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+11:2360:x1874622505131904:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 126us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779676.957995:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 21 00000100:00100000:3.0:1787779676.958017:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 22 00000100:00100000:3.0:1787779676.958023:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e74353e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+10:2360:x1874622505132032:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787779676.958031:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787779676.958039:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e87a98b200/0x9e63ba8af688901d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedabae expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779676.958065:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787779676.958081:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e74353e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+9:2360:x1874622505132032:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 59us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779676.958087:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 22 00000100:00100000:3.0:1787779676.958098:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 23 00000100:00100000:3.0:1787779676.958144:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e74353f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+8:2359:x1874622505132160:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787779676.958152:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787779676.958160:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e87a98ac00/0x9e63ba8af68891b3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedac33 expref: 8 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779676.958168:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787779676.958182:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e74353f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+7:2359:x1874622505132160:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 79us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779676.958187:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 23 00000100:00100000:1.0:1787779676.965960:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779676.966051:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505132416 00000100:00100000:3.0:1787779676.966063:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505132416 00000100:00100000:3.0:1787779676.966138:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 241 00000100:00100000:3.0:1787779676.966149:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec9e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54e1e60c-3037-4ae3-b045-838eb9e0ad0b+6:2356:x1874622505132416:12345-192.168.201.9@tcp:39:umount.0 00000020:00000080:3.0:1787779676.966197:0:5837:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9e63ba8af688902b 00000020:00010000:3.0:1787779676.966208:0:5837:0:(genops.c:1921:obd_stale_export_put()) Put export ffff98e851786800: total 0 00000100:00080000:3.0:1787779676.966213:0:5837:0:(import.c:65:import_set_state_nolock()) ffff98e851782000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787779676.966244:0:5837:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000020:00010000:1.0:1787779676.966537:0:5825:0:(genops.c:1907:obd_stale_export_get()) Get export ffff98e851786800: total 0 00010000:00010000:1.0:1787779676.966541:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779676.966580:0:5825:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff98e851786800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1787779676.966623:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e87450a400) 00010000:00010000:1.0:1787779676.966626:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787779676.966634:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98aa00/0x9e63ba8af6889f58 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedafe4 expref: 5 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779676.966658:0:5825:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff98e851786800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1787779676.966670:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779676.966672:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779676.966673:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779676.968640:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec9e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54e1e60c-3037-4ae3-b045-838eb9e0ad0b+3:2356:x1874622505132416:12345-192.168.201.9@tcp:39:umount.0 Request processed in 2481us (2689us total) trans 4294967527 rc 0/0 00000100:00100000:3.0:1787779676.968657:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 241 00000100:00100000:3.0:1787779677.013539:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779677.013684:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505132672 00000100:00100000:2.0:1787779677.013695:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505132672 00000100:00100000:2.0:1787779677.014118:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 313 00000100:00100000:2.0:1787779677.014130:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+7:2356:x1874622505132672:12345-192.168.201.9@tcp:251:umount.0 00000020:00000080:2.0:1787779677.014192:0:5831:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9e63ba8af6888f21 00000020:00010000:2.0:1787779677.014200:0:5831:0:(genops.c:1921:obd_stale_export_put()) Put export ffff98e851786000: total 0 00000100:00080000:2.0:1787779677.014204:0:5831:0:(import.c:65:import_set_state_nolock()) ffff98e851787000 : changing import state from FULL to CLOSED 00000020:00010000:0.0:1787779677.014241:0:5824:0:(genops.c:1907:obd_stale_export_get()) Get export ffff98e851786000: total 0 00000100:00100000:2.0:1787779677.014282:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e+3:2356:x1874622505132672:12345-192.168.201.9@tcp:251:umount.0 Request processed in 154us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779677.014292:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 313 00010000:00010000:0.0:1787779677.014296:0:5824:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff98e851786000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1787779677.014335:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e87a98a800/0x9e63ba8af6888fd7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedab76 expref: 2 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779677.014351:0:5824:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff98e851786000, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1787779677.014364:0:5824:0:(genops.c:885:class_export_put()) final put ffff98e851786000/ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e 00000020:00000080:3.0:1787779677.019548:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98e851786000/ea2841ac-9e8f-48c2-8bf9-b83b4c5cb99e for MGS 00000020:00000080:3.0:1787779677.019640:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98e851787000 for MGS 00010000:00010000:0.0:1787779677.019989:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779677.019993:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779677.019996:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787779677.621254:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ec9fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622525037184:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787779677.621323:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779677.621433:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525037184 00000100:00100000:1.0:1787779677.621441:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525037184 00000100:00100000:1.0:1787779677.621502:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787779677.621512:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622525037184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787779677.621547:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787779677.621600:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622525037184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779677.621608:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:2.0:1787779677.621890:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787779677.621922:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ec9fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622525037184:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787779677.813617:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787779678.644843:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ec98780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874622525037440:0@lo:400:kworker.0 00000100:00100000:2.0:1787779678.644953:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779678.645004:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f6b7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874622525037952:0@lo:400:kworker.0 00000100:00100000:2.0:1787779678.645045:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779678.645075:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787779678.645082:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ec99e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c28aae66-2825-42c5-8f52-61f687e868c9:3305:1874622525037312:0@lo:400:kworker.0 00000100:00100000:2.0:1787779678.645427:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779678.645504:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ec98f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874622525037824:0@lo:400:kworker.0 00000100:00100000:2.0:1787779678.645531:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779678.645561:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ec9b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874622525037568:0@lo:400:kworker.0 00000100:00100000:2.0:1787779678.645583:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779678.645600:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787779678.645605:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ec9b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622525037696:0@lo:400:kworker.0 00000100:00100000:2.0:1787779678.645627:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779678.645679:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525037440 00000100:00100000:2.0:1787779678.645686:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525037440 00000100:00100000:2.0:1787779678.645745:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525037824 00000100:00100000:2.0:1787779678.645748:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525037824 00000100:00100000:2.0:1787779678.645766:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525037568 00000100:00100000:2.0:1787779678.645768:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525037568 00000100:00100000:2.0:1787779678.645783:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1787779678.645791:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e741e6fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874622525037440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779678.645842:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e741e6fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874622525037440:12345-0@lo:400:kworker.0 Request processed in 52us (890us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779678.645849:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1787779678.645865:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1787779678.645870:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e741e6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874622525037824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779678.645897:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e741e6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874622525037824:12345-0@lo:400:kworker.0 Request processed in 27us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779678.645902:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1787779678.645913:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1787779678.645919:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e741e6da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874622525037568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779678.645963:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e741e6da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874622525037568:12345-0@lo:400:kworker.0 Request processed in 44us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779678.645968:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1787779678.645986:0:10229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525037952 00000100:00100000:2.0:1787779678.645989:0:10229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525037952 00000100:00100000:2.0:1787779678.646011:0:10229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525037696 00000100:00100000:2.0:1787779678.646015:0:10229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525037696 00000100:00100000:2.0:1787779678.646034:0:10229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787779678.646041:0:10229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e741e6cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874622525037952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779678.646071:0:10229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e741e6cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874622525037952:12345-0@lo:400:kworker.0 Request processed in 31us (1025us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779678.646082:0:10229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787779678.646093:0:10229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787779678.646681:0:10229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e741e6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622525037696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779678.646743:0:10229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e741e6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622525037696:12345-0@lo:400:kworker.0 Request processed in 644us (1114us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779678.646751:0:10229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:2.0:1787779678.646773:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787779678.646777:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787779678.646808:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ec9b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622525037696:0@lo:400:kworker.0 00000100:00100000:2.0:1787779678.646820:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ec9b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874622525037568:0@lo:400:kworker.0 00000100:00100000:2.0:1787779678.646850:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ec98f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874622525037824:0@lo:400:kworker.0 00000100:00100000:2.0:1787779678.646859:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ec98780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874622525037440:0@lo:400:kworker.0 00000100:00100000:2.0:1787779678.646868:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f6b7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874622525037952:0@lo:400:kworker.0 00000100:00100000:0.0:1787779678.653479:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525037312 00000100:00100000:0.0:1787779678.653494:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525037312 00000100:00100000:0.0:1787779678.655654:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1787779678.655667:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+19:3305:x1874622525037312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779678.655796:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c28aae66-2825-42c5-8f52-61f687e868c9+19:3305:x1874622525037312:12345-0@lo:400:kworker.0 Request processed in 132us (10435us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779678.655804:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1787779678.655871:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ec99e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c28aae66-2825-42c5-8f52-61f687e868c9:3305:1874622525037312:0@lo:400:kworker.0 00000020:01000004:1.0:1787779678.674848:0:12907:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1787779678.705517:0:12907:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1787779678.705577:0:12907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e841649000/0x9e63ba8af6888fa6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888fad expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779678.705595:0:12907:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e841649000/0x9e63ba8af6888fa6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9e63ba8af6888fad expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779678.705603:0:12907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e841649000/0x9e63ba8af6888fa6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x9e63ba8af6888fad expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779678.705611:0:12907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.109@tcp lock: ffff98e841649000/0x9e63ba8af6888fa6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x9e63ba8af6888fad expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779678.705637:0:12907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787779678.705644:0:12907:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1787779678.705677:0:12907:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787779678.705681:0:12907:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787779678.705687:0:12907:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787779678.705932:0:12907:0:(import.c:65:import_set_state_nolock()) ffff98e85f5ec800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1787779678.706976:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787779678.706985:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff98e841649000/0x9e63ba8af6888fa6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x9e63ba8af6888fad expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779678.706996:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e841649000 already unused, calling callback (ffffffffc1cd5c20) 10000000:00010000:2.0:1787779678.707001:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff98e841649000/0x9e63ba8af6888fa6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x9e63ba8af6888fad expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779678.707011:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff98e841649000/0x9e63ba8af6888fa6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x9e63ba8af6888fad expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787779678.707019:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff98e841649000/0x9e63ba8af6888fa6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x9e63ba8af6888fad expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787779678.707042:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787779678.707045:0:5825:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787779678.707048:0:5825:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787779678.707082:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.109@tcp lock: ffff98e841649000/0x9e63ba8af6888fa6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9e63ba8af6888fad expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779678.707089:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787779678.707125:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff98e841649000/0x9e63ba8af6888fa6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9e63ba8af6888fad expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779678.707125:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ec9d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874622525038080:0@lo:39:umount.0 00010000:00010000:2.0:1787779678.707139:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff98e841649000/0x9e63ba8af6888fa6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9e63ba8af6888fad expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779678.707155:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779678.707157:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779678.707158:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787779678.707168:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787779678.707184:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e741e6c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c28aae66-2825-42c5-8f52-61f687e868c9:3307:1874622525038208:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787779678.707215:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779678.707230:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779678.707282:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525038080 00000100:00100000:1.0:1787779678.707289:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525038080 00000100:00100000:1.0:1787779678.707345:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1787779678.707355:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec9fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874622525038080:12345-0@lo:39:umount.0 00000100:00100000:3.0:1787779678.707462:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525038208 00000100:00100000:3.0:1787779678.707467:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525038208 00000100:00100000:3.0:1787779678.707512:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787779678.707520:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e741e6cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c28aae66-2825-42c5-8f52-61f687e868c9+19:3307:x1874622525038208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787779678.707533:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787779678.707550:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e87a98ba00/0x9e63ba8af6888fad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9e63ba8af6888fa6 expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779678.707564:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787779678.707615:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e741e6cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c28aae66-2825-42c5-8f52-61f687e868c9+18:3307:x1874622525038208:12345-0@lo:103:ldlm_bl.0 Request processed in 96us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779678.707623:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000020:00000080:1.0:1787779678.707695:0:8197:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9e63ba8af6888d3e 00000100:00080000:1.0:1787779678.707704:0:8197:0:(import.c:65:import_set_state_nolock()) ffff98e873e87000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1787779678.707775:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e741e6c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c28aae66-2825-42c5-8f52-61f687e868c9:3307:1874622525038208:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787779678.707802:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec9fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3303:x1874622525038080:12345-0@lo:39:umount.0 Request processed in 448us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779678.707810:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:1.0:1787779678.707817:0:8197:0:(genops.c:885:class_export_put()) final put ffff98e873e85000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:1.0:1787779678.707862:0:3303:0:(import.c:65:import_set_state_nolock()) ffff98e85f5ec800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1787779678.707874:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ec9d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874622525038080:0@lo:39:umount.0 00000100:00080000:1.0:1787779678.707899:0:12907:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787779678.707902:0:12907:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787779678.707906:0:12907:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787779678.707950:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff98e873e85000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1787779678.708011:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98e873e87000 for lustre-MDT0000 00010000:00010000:3.0:1787779678.708586:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779678.711806:0:12907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e841648e00/0x9e63ba8af6888fb4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888fbb expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779678.711831:0:12907:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e841648e00/0x9e63ba8af6888fb4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9e63ba8af6888fbb expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779678.711839:0:12907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e841648e00/0x9e63ba8af6888fb4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x9e63ba8af6888fbb expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779678.711847:0:12907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.109@tcp lock: ffff98e841648e00/0x9e63ba8af6888fb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x9e63ba8af6888fbb expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779678.711875:0:12907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787779678.711881:0:12907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e882048800/0x9e63ba8af6888edb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888ee2 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779678.711887:0:12907:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e882048800/0x9e63ba8af6888edb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9e63ba8af6888ee2 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779678.711910:0:12907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e882048800/0x9e63ba8af6888edb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9e63ba8af6888ee2 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779678.711917:0:12907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.109@tcp lock: ffff98e882048800/0x9e63ba8af6888edb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9e63ba8af6888ee2 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779678.711934:0:8500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787779678.711939:0:12907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787779678.711947:0:12907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e8429d4a00/0x9e63ba8af68891dd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af68891e4 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779678.711954:0:12907:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e8429d4a00/0x9e63ba8af68891dd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9e63ba8af68891e4 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779678.711961:0:12907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e8429d4a00/0x9e63ba8af68891dd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9e63ba8af68891e4 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779678.712009:0:8500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff98e841648e00/0x9e63ba8af6888fb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x9e63ba8af6888fbb expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779678.712018:0:8500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e841648e00 already unused, calling callback (ffffffffc1cd5c20) 10000000:00010000:3.0:1787779678.712021:0:8500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff98e841648e00/0x9e63ba8af6888fb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x9e63ba8af6888fbb expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779678.712030:0:8500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff98e841648e00/0x9e63ba8af6888fb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x9e63ba8af6888fbb expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787779678.712037:0:8500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff98e841648e00/0x9e63ba8af6888fb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x9e63ba8af6888fbb expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787779678.712056:0:8500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787779678.712058:0:8500:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1787779678.712095:0:8500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.109@tcp lock: ffff98e841648e00/0x9e63ba8af6888fb4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9e63ba8af6888fbb expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779678.712158:0:8500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787779678.712185:0:8500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff98e841648e00/0x9e63ba8af6888fb4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9e63ba8af6888fbb expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779678.712192:0:8500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff98e841648e00/0x9e63ba8af6888fb4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9e63ba8af6888fbb expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779678.712208:0:8500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787779678.712211:0:8500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff98e882048800/0x9e63ba8af6888edb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9e63ba8af6888ee2 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779678.712217:0:8500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e882048800 already unused, calling callback (ffffffffc1cd5c20) 10000000:00010000:3.0:1787779678.712220:0:8500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff98e882048800/0x9e63ba8af6888edb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9e63ba8af6888ee2 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779678.712225:0:8500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff98e882048800/0x9e63ba8af6888edb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9e63ba8af6888ee2 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787779678.712231:0:8500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff98e882048800/0x9e63ba8af6888edb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9e63ba8af6888ee2 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787779678.712236:0:8500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1787779678.712238:0:8500:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1787779678.712240:0:8500:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1787779678.712262:0:8500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.109@tcp lock: ffff98e882048800/0x9e63ba8af6888edb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9e63ba8af6888ee2 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779678.712268:0:8500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787779678.712285:0:8500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff98e882048800/0x9e63ba8af6888edb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9e63ba8af6888ee2 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779678.712293:0:8500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff98e882048800/0x9e63ba8af6888edb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9e63ba8af6888ee2 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779678.712306:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787779678.712307:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787779678.712309:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779678.712328:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e74353c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c28aae66-2825-42c5-8f52-61f687e868c9:3304:1874622525038464:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787779678.712500:0:12907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.109@tcp lock: ffff98e8429d4a00/0x9e63ba8af68891dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9e63ba8af68891e4 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779678.712516:0:12907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787779678.712527:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787779678.712531:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff98e8429d4a00/0x9e63ba8af68891dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9e63ba8af68891e4 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779678.712596:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e8429d4a00 already unused, calling callback (ffffffffc1cd5c20) 10000000:00010000:1.0:1787779678.712599:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff98e8429d4a00/0x9e63ba8af68891dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9e63ba8af68891e4 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779678.712606:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff98e8429d4a00/0x9e63ba8af68891dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9e63ba8af68891e4 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787779678.712619:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff98e8429d4a00/0x9e63ba8af68891dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9e63ba8af68891e4 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787779678.712623:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787779678.712625:0:5824:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787779678.712627:0:5824:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787779678.712641:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.109@tcp lock: ffff98e8429d4a00/0x9e63ba8af68891dd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9e63ba8af68891e4 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779678.712647:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787779678.712703:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff98e8429d4a00/0x9e63ba8af68891dd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9e63ba8af68891e4 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779678.712738:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff98e8429d4a00/0x9e63ba8af68891dd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9e63ba8af68891e4 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779678.712751:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779678.712753:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779678.712755:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779678.712765:0:12907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e882049e00/0x9e63ba8af6888c8f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888c96 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779678.712773:0:12907:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e882049e00/0x9e63ba8af6888c8f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9e63ba8af6888c96 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779678.712789:0:12907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e882049e00/0x9e63ba8af6888c8f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9e63ba8af6888c96 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779678.712795:0:12907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.109@tcp lock: ffff98e882049e00/0x9e63ba8af6888c8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9e63ba8af6888c96 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779678.712817:0:12907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787779678.712821:0:12907:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1787779678.712824:0:12907:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1787779678.712861:0:12907:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1787779678.712866:0:12907:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1787779678.712870:0:12907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787779678.712875:0:12907:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/9 00000020:00080000:1.0:1787779678.712881:0:12907:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff98e851762800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787779678.712887:0:12907:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff98e85ff68000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787779678.712894:0:12907:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff98e851786800 54e1e60c-3037-4ae3-b045-838eb9e0ad0b 192.168.201.9@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787779678.712899:0:12907:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff98e881a49800 e225400f-8d32-48a8-ab5e-fe4d3780a20c 192.168.201.9@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 4294967525 stale:0 00000020:00080000:1.0:1787779678.712904:0:12907:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff98e874593370) has exports, disconnecting them 00000020:00080000:1.0:1787779678.712908:0:12907:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff98e851762800), last request at 1787779678 00000020:00000080:1.0:1787779678.712914:0:12907:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9e63ba8af6888ea3 00000100:00080000:1.0:1787779678.712957:0:12907:0:(import.c:65:import_set_state_nolock()) ffff98e851761000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1787779678.712990:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787779678.712995:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff98e882049e00/0x9e63ba8af6888c8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9e63ba8af6888c96 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779678.713001:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e882049e00 already unused, calling callback (ffffffffc1cd5c20) 10000000:00010000:1.0:1787779678.713004:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff98e882049e00/0x9e63ba8af6888c8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9e63ba8af6888c96 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779678.713011:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff98e882049e00/0x9e63ba8af6888c8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9e63ba8af6888c96 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787779678.713017:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff98e882049e00/0x9e63ba8af6888c8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9e63ba8af6888c96 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787779678.713029:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1787779678.713031:0:5824:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1787779678.713033:0:5824:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1787779678.713047:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.109@tcp lock: ffff98e882049e00/0x9e63ba8af6888c8f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9e63ba8af6888c96 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779678.713053:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787779678.713060:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff98e882049e00/0x9e63ba8af6888c8f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9e63ba8af6888c96 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779678.713065:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff98e882049e00/0x9e63ba8af6888c8f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9e63ba8af6888c96 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779678.713077:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779678.713079:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779678.713080:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1787779678.713095:0:12907:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff98e851762800): rc 0 00000020:00000080:1.0:1787779678.713104:0:12907:0:(genops.c:885:class_export_put()) final put ffff98e851762800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1787779678.713116:0:12907:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff98e85ff68000), last request at 1787779678 00000020:00000080:1.0:1787779678.713120:0:12907:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9e63ba8af6888dd8 00000100:00080000:1.0:1787779678.713125:0:12907:0:(import.c:65:import_set_state_nolock()) ffff98e85ff68800 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1787779678.713139:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98e851762800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1787779678.713184:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98e851761000 for lustre-MDT0000 00010000:00010000:1.0:1787779678.713194:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1787779678.713473:0:12907:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff98e85ff68000): rc 0 00000020:00000080:1.0:1787779678.713475:0:12907:0:(genops.c:885:class_export_put()) final put ffff98e85ff68000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:1.0:1787779678.713486:0:12907:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffbf1d81cbbae0 00000020:00000080:1.0:1787779678.713495:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff98e85ff68000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1787779678.713520:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98e85ff68800 for lustre-MDT0000 00000100:00100000:3.0:1787779678.713547:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779678.713600:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787779678.713609:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ec9d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c28aae66-2825-42c5-8f52-61f687e868c9:3304:1874622525038592:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1787779678.713617:0:12907:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787779678.713621:0:12907:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:1.0:1787779678.713633:0:12907:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787779678.713649:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779678.713679:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e842fecf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c28aae66-2825-42c5-8f52-61f687e868c9:3306:1874622525038720:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787779678.713706:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779678.713741:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787779678.713746:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e74353cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c28aae66-2825-42c5-8f52-61f687e868c9:3306:1874622525038336:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787779678.713766:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779678.713791:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525038464 00000100:00100000:3.0:1787779678.713798:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525038464 00000100:00100000:3.0:1787779678.713834:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525038592 00000100:00100000:3.0:1787779678.713838:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525038592 00000100:00100000:3.0:1787779678.713850:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525038720 00000100:00100000:3.0:1787779678.713852:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525038720 00000100:00100000:3.0:1787779678.713861:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525038336 00000100:00100000:3.0:1787779678.713868:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525038336 00000100:00100000:3.0:1787779678.713887:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787779678.713894:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e74353da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c28aae66-2825-42c5-8f52-61f687e868c9+21:3304:x1874622525038464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787779678.713908:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1787779678.713918:0:11162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787779678.713939:0:11162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e743507840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c28aae66-2825-42c5-8f52-61f687e868c9+21:3304:x1874622525038592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787779678.713948:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e8429d4600/0x9e63ba8af6888ee2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9e63ba8af6888edb expref: 21 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779678.713949:0:11162:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787779678.713958:0:11162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e87a98a200/0x9e63ba8af68891e4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9e63ba8af68891dd expref: 20 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779678.713966:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787779678.713966:0:11162:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787779678.713999:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e74353da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c28aae66-2825-42c5-8f52-61f687e868c9+19:3304:x1874622525038464:12345-0@lo:103:ldlm_bl.0 Request processed in 105us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779678.714005:0:11162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e743507840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c28aae66-2825-42c5-8f52-61f687e868c9+19:3304:x1874622525038592:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779678.714007:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787779678.714010:0:11162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787779678.714024:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787779678.714027:0:11162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787779678.714029:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e847d95850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c28aae66-2825-42c5-8f52-61f687e868c9+17:3306:x1874622525038720:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787779678.714031:0:11162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e7435070c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c28aae66-2825-42c5-8f52-61f687e868c9+17:3306:x1874622525038336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787779678.714039:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787779678.714039:0:11162:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787779678.714048:0:11162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e882049400/0x9e63ba8af6888fbb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9e63ba8af6888fb4 expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779678.714049:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e841649400/0x9e63ba8af6888c96 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9e63ba8af6888c8f expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779678.714058:0:11162:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787779678.714070:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787779678.714936:0:11162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e7435070c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c28aae66-2825-42c5-8f52-61f687e868c9+15:3306:x1874622525038336:12345-0@lo:103:ldlm_bl.0 Request processed in 901us (1165us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779678.714941:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e847d95850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c28aae66-2825-42c5-8f52-61f687e868c9+15:3306:x1874622525038720:12345-0@lo:103:ldlm_bl.0 Request processed in 912us (1234us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779678.714945:0:11162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787779678.714948:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787779678.714985:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e74353cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c28aae66-2825-42c5-8f52-61f687e868c9:3306:1874622525038336:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787779678.714995:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e842fecf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c28aae66-2825-42c5-8f52-61f687e868c9:3306:1874622525038720:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1787779678.715015:0:12907:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00010000:00010000:3.0:1787779678.715017:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779678.715030:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ec9d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c28aae66-2825-42c5-8f52-61f687e868c9:3304:1874622525038592:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1787779678.715031:0:12907:0:(import.c:65:import_set_state_nolock()) ffff98e85fdcd000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1787779678.715037:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e74353c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c28aae66-2825-42c5-8f52-61f687e868c9:3304:1874622525038464:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1787779678.715055:0:12907:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787779678.715058:0:12907:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:1.0:1787779678.715081:0:12907:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787779678.715160:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e842fecf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874622525038848:0@lo:9:umount.0 00000001:00100000:0.0:1787779678.715206:0:7634:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e225400f-8d32-48a8-ab5e-fe4d3780a20c 00000020:00000080:0.0:1787779678.715212:0:7634:0:(genops.c:885:class_export_put()) final put ffff98e881da1800/e225400f-8d32-48a8-ab5e-fe4d3780a20c 00000100:00100000:1.0:1787779678.715367:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:1.0:1787779678.715471:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98e881da1800/e225400f-8d32-48a8-ab5e-fe4d3780a20c for lustre-OST0001 00000020:00000080:1.0:1787779678.715512:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98e881da1000 for lustre-OST0001 00000100:00080000:1.0:1787779678.715524:0:12907:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1787779678.715535:0:12907:0:(import.c:65:import_set_state_nolock()) ffff98e851780000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1787779678.715560:0:10229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525038848 00000100:00100000:0.0:1787779678.715567:0:10229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525038848 00000100:00100000:0.0:1787779678.715618:0:10229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787779678.715629:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ab352c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874622525038976:0@lo:9:umount.0 00000100:00100000:0.0:1787779678.715639:0:10229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e844d29a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1874622525038848:12345-0@lo:9:umount.0 00000020:00000080:0.0:1787779678.715662:0:10229:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9e63ba8af6888e25 00000100:00100000:1.0:1787779678.715671:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787779678.715672:0:10229:0:(import.c:65:import_set_state_nolock()) ffff98e85fdcb000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1787779678.715707:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525038976 00000100:00100000:1.0:1787779678.715736:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525038976 00000001:00000004:0.0:1787779678.715740:0:10229:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:3.0:1787779678.715764:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787779678.715775:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e852b9e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874622525038976:12345-0@lo:9:umount.0 00010000:00010000:1.0:1787779678.715775:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787779678.715798:0:6680:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9e63ba8af6888f13 00000100:00080000:3.0:1787779678.715805:0:6680:0:(import.c:65:import_set_state_nolock()) ffff98e851766800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787779678.715829:0:6680:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000020:00080000:1.0:1787779678.715829:0:12907:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff98e874593370) has no exports 00010000:00010000:2.0:1787779678.716119:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779678.716125:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e852b9e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3303:x1874622525038976:12345-0@lo:9:umount.0 Request processed in 351us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779678.716134:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00010000:3.0:1787779678.716154:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779678.716457:0:10229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e844d29a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3303:x1874622525038848:12345-0@lo:9:umount.0 Request processed in 821us (1089us total) trans 0 rc 0/0 00000100:00080000:1.0:1787779678.716503:0:3303:0:(import.c:65:import_set_state_nolock()) ffff98e851780000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1787779678.716522:0:3303:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1787779678.716525:0:3303:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787779678.716529:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ab352c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874622525038976:0@lo:9:umount.0 00000100:00080000:1.0:1787779678.716552:0:3303:0:(import.c:65:import_set_state_nolock()) ffff98e85fdcd000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1787779678.716569:0:3303:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1787779678.716571:0:3303:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787779678.716574:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e842fecf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874622525038848:0@lo:9:umount.0 00000100:00100000:0.0:1787779678.716955:0:10229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000020:00080000:2.0:1787779678.728272:0:12907:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff98e874593370) has no exports 00000020:00000080:2.0:1787779678.804125:0:12907:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9e63ba8af6888cea 00000020:00000080:2.0:1787779678.804142:0:12907:0:(genops.c:885:class_export_put()) final put ffff98e85f5ef000/lustre-QMT0000_UUID 00000020:01000000:2.0:1787779678.804212:0:12907:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1787779678.807995:0:12907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787779678.808026:0:12907:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787779678.808032:0:12907:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff98e848ef4d28) has no exports 00000020:00000080:2.0:1787779678.808311:0:12907:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9e63ba8af6888ce3 00000020:00000080:2.0:1787779678.808320:0:12907:0:(genops.c:885:class_export_put()) final put ffff98e874433000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787779678.808380:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff98e85f5ef000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1787779678.812081:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff98e874433000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787779678.812172:0:12907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787779678.812181:0:12907:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1787779678.812187:0:12907:0:(genops.c:885:class_export_put()) final put ffff98e874430800/lustre-QMT0000_UUID 00000020:00000080:3.0:1787779678.812190:0:12907:0:(genops.c:844:class_export_destroy()) destroying export ffff98e874430800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1787779678.812194:0:12907:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:1.0:1787779678.834944:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787779679.748964:0:5857:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e225400f-8d32-48a8-ab5e-fe4d3780a20c 00000001:00080000:2.0:1787779679.748984:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:2.0:1787779679.748991:0:5857:0:(genops.c:885:class_export_put()) final put ffff98e881a49800/e225400f-8d32-48a8-ab5e-fe4d3780a20c 00000020:00000080:2.0:1787779679.749018:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff98e881a49800/e225400f-8d32-48a8-ab5e-fe4d3780a20c for lustre-MDT0000 00000020:00000080:2.0:1787779679.749088:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98e881a4e000 for lustre-MDT0000 00000001:00100000:2.0:1787779679.749107:0:5857:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 54e1e60c-3037-4ae3-b045-838eb9e0ad0b 00000001:00080000:2.0:1787779679.749113:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:2.0:1787779679.749115:0:5857:0:(genops.c:885:class_export_put()) final put ffff98e851786800/54e1e60c-3037-4ae3-b045-838eb9e0ad0b 00000020:00000080:2.0:1787779679.749127:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff98e851786800/54e1e60c-3037-4ae3-b045-838eb9e0ad0b for lustre-MDT0000 00000020:00000080:2.0:1787779679.749152:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98e851782000 for lustre-MDT0000 00000001:00100000:3.0:1787779679.772971:0:6704:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787779679.772982:0:6704:0:(genops.c:885:class_export_put()) final put ffff98e85fdca000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1787779679.773002:0:6704:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e225400f-8d32-48a8-ab5e-fe4d3780a20c 00000020:00000080:3.0:1787779679.773004:0:6704:0:(genops.c:885:class_export_put()) final put ffff98e881da2800/e225400f-8d32-48a8-ab5e-fe4d3780a20c 00000020:00000080:3.0:1787779679.773019:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff98e85fdca000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1787779679.773062:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff98e881da2800/e225400f-8d32-48a8-ab5e-fe4d3780a20c for lustre-OST0000 00000020:00000080:3.0:1787779679.773083:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98e85fdcb000 for lustre-OST0000 00000020:00000080:3.0:1787779679.773087:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98e881da5800 for lustre-OST0000 00010000:00010000:2.0:1787779679.861375:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1787779680.819471:0:12907:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff98e847d4c120 - data ffff98e87f8d2360/ffff98e87f649400 00000020:01000000:3.0:1787779680.819668:0:12907:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff98e8430ff000 - data ffff98e864ff5510/ffff98e85f5e5800 00000001:00000004:3.0:1787779680.832181:0:12907:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00010000:00010000:3.0:1787779680.891226:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787779680.951061:0:12907:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787779680.951071:0:12907:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1787779680.951140:0:12907:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787779680.951143:0:12907:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787779680.951898:0:6853:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787779680.951904:0:6853:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:1.0:1787779680.951915:0:6853:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1787779680.952917:0:12907:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787779680.952923:0:12907:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1787779680.952941:0:12907:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787779680.952943:0:12907:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787779680.953280:0:8050:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787779680.953293:0:8050:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:1.0:1787779680.953302:0:8050:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1787779681.006792:0:12907:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9e63ba8af6888cb2 00000020:00000080:0.0:1787779681.006807:0:12907:0:(genops.c:885:class_export_put()) final put ffff98e8745a0800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787779681.007986:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff98e8745a0800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787779681.008486:0:12907:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9e63ba8af6888cc7 00000020:00000080:0.0:1787779681.008496:0:12907:0:(genops.c:885:class_export_put()) final put ffff98e8745a6800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1787779681.008548:0:12907:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1787779681.008554:0:12907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787779681.008563:0:12907:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787779681.008568:0:12907:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff98e874590000) has no exports 00000004:01000000:0.0:1787779681.008762:0:12907:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1787779681.008771:0:12907:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9e63ba8af6888f05 00000020:00000080:0.0:1787779681.008775:0:12907:0:(genops.c:885:class_export_put()) final put ffff98e881a4b800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787779681.009575:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff98e8745a6800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1787779681.009642:0:12907:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1787779681.009648:0:12907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787779681.009656:0:12907:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787779681.009660:0:12907:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff98e842f1cd28) has no exports 00000020:00000080:0.0:1787779681.009666:0:12907:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9e63ba8af6888efe 00000020:00000080:0.0:1787779681.009671:0:12907:0:(genops.c:885:class_export_put()) final put ffff98e851787800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787779681.009772:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff98e881a4b800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1787779681.009779:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff98e851787800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1787779681.010241:0:12907:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1787779681.010247:0:12907:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787779681.010250:0:12907:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:0.0:1787779681.010257:0:12907:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787779681.010259:0:12907:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787779681.010339:0:12907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787779681.010347:0:12907:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787779681.010367:0:12907:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9e63ba8af6888e1e 00000020:00000080:0.0:1787779681.010372:0:12907:0:(genops.c:885:class_export_put()) final put ffff98e87ed80800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787779681.010678:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98e851780000 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1787779681.010685:0:38:0:(genops.c:885:class_export_put()) final put ffff98e881a4d000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787779681.010694:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff98e881a4d000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1787779681.010698:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1787779681.010983:0:12907:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1787779681.011062:0:12907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787779681.011069:0:12907:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787779681.011073:0:12907:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff98e87f0399b8) has no exports 00000020:00000080:0.0:1787779681.011078:0:12907:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9e63ba8af6888e17 00000020:00000080:0.0:1787779681.011082:0:12907:0:(genops.c:885:class_export_put()) final put ffff98e85fdca800/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1787779681.011431:0:12907:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1787779681.011434:0:12907:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787779681.011437:0:12907:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:0.0:1787779681.011442:0:12907:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787779681.011444:0:12907:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787779681.011471:0:12907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787779681.011476:0:12907:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787779681.011507:0:12907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787779681.011510:0:12907:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787779681.011513:0:12907:0:(genops.c:885:class_export_put()) final put ffff98e852bac800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787779681.011516:0:12907:0:(genops.c:844:class_export_destroy()) destroying export ffff98e852bac800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1787779681.011520:0:12907:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787779681.011654:0:12907:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9e63ba8af6888cce 00000020:00000080:0.0:1787779681.011659:0:12907:0:(genops.c:885:class_export_put()) final put ffff98e8745a3800/lustre-MDD0000_UUID 00000020:01000000:0.0:1787779681.011663:0:12907:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1787779681.011666:0:12907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787779681.011670:0:12907:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787779681.011673:0:12907:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff98e8745919b8) has no exports 00000020:00000080:0.0:1787779681.011690:0:12907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787779681.011693:0:12907:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1787779681.011697:0:12907:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9e63ba8af6888cd5 00000020:00000080:0.0:1787779681.011700:0:12907:0:(genops.c:885:class_export_put()) final put ffff98e8745a5800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1787779681.011708:0:12907:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98e846b05800 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1787779681.011782:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff98e87ed80800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1787779681.011789:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff98e85fdca800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787779681.011793:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98e85fdcd000 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1787779681.011798:0:38:0:(genops.c:885:class_export_put()) final put ffff98e87ed82800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787779681.011800:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff98e87ed82800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1787779681.011803:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787779681.012034:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff98e8745a3800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1787779681.012038:0:38:0:(genops.c:885:class_export_put()) final put ffff98e8745a1000/lustre-MDD0000_UUID 00000020:00000080:2.0:1787779681.012040:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff98e8745a1000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1787779681.012044:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1787779681.012186:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff98e8745a5800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:0.0:1787779681.012233:0:12907:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98e846b05800 3 00000020:01000004:0.0:1787779681.012245:0:12907:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff98e846b05800 from lustre-MDT0000 00000020:00000080:0.0:1787779681.012263:0:12907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787779681.012267:0:12907:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1787779681.012270:0:12907:0:(genops.c:885:class_export_put()) final put ffff98e8745a0000/lustre-MDT0000_UUID 00000020:00000080:0.0:1787779681.012272:0:12907:0:(genops.c:844:class_export_destroy()) destroying export ffff98e8745a0000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1787779681.012279:0:12907:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1787779681.012303:0:12907:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:0.0:1787779681.012306:0:12907:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1787779681.012309:0:12907:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1787779681.012311:0:12907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787779681.012314:0:12907:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787779681.012320:0:12907:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff98e844cfe800 c28aae66-2825-42c5-8f52-61f687e868c9 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787779681.012325:0:12907:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff98e848ef19b8) has exports, disconnecting them 00000020:00080000:0.0:1787779681.012329:0:12907:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff98e844cfe800), last request at 1787779428 00000020:00000080:0.0:1787779681.012343:0:12907:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9e63ba8af6888c73 00000020:00010000:0.0:1787779681.012346:0:12907:0:(genops.c:1921:obd_stale_export_put()) Put export ffff98e844cfe800: total 0 00000100:00080000:0.0:1787779681.012350:0:12907:0:(import.c:65:import_set_state_nolock()) ffff98e844cfc800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787779681.012368:0:12907:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff98e844cfe800): rc 0 00000020:00080000:0.0:1787779681.012372:0:12907:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff98e848ef19b8) has no exports 00000100:00100000:0.0:1787779681.012422:0:5828:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff98e871070000:5828] 0 exiting: rc = 1 00000100:00100000:0.0:1787779681.012499:0:5830:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff98e842ea2600:5830] 1 exiting: rc = 0 00000020:00010000:1.0:1787779681.012745:0:5824:0:(genops.c:1907:obd_stale_export_get()) Get export ffff98e844cfe800: total 0 00010000:00010000:1.0:1787779681.012773:0:5824:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff98e844cfe800, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1787779681.012799:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e841649a00/0x9e63ba8af6888f9f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9e63ba8af6888f98 expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779681.012815:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e8429d4200/0x9e63ba8af68891d6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9e63ba8af68891cf expref: 8 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779681.012946:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e882049000/0x9e63ba8af6888fc9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9e63ba8af6888fc2 expref: 7 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779681.012962:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e87aa66c00/0x9e63ba8af68891c8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9e63ba8af68891c1 expref: 6 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779681.012975:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e882049600/0x9e63ba8af6888d8b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9e63ba8af6888d84 expref: 5 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779681.012994:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e848f69000/0x9e63ba8af6888f75 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9e63ba8af6888f6e expref: 4 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779681.013005:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e848f69a00/0x9e63ba8af6888f91 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9e63ba8af6888f8a expref: 3 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779681.013015:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e87a98b400/0x9e63ba8af6888f83 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9e63ba8af6888f7c expref: 2 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779681.013025:0:5824:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff98e844cfe800, canceled 8 locks, left on hash table 0. 00000020:00000080:1.0:1787779681.013036:0:5824:0:(genops.c:885:class_export_put()) final put ffff98e844cfe800/c28aae66-2825-42c5-8f52-61f687e868c9 00010000:00010000:1.0:1787779681.013050:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779681.013058:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779681.013060:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787779681.013267:0:5831:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff98e842ea2c00:5831] 2 exiting: rc = 0 00000020:00000080:0.0:1787779681.013353:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff98e844cfe800/c28aae66-2825-42c5-8f52-61f687e868c9 for MGS 00000100:00100000:1.0:1787779681.014264:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.014273:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.014279:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.014285:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.014290:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.014296:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.014301:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.014307:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.014313:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.014318:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.014324:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.014329:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.014335:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.014340:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.014345:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.014352:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.014358:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.014363:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.014368:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.014375:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.014381:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.014387:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.014392:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.014398:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.014403:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.014409:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.014414:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.014420:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.014425:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.014430:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.014435:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.014440:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.014445:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.014458:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.014464:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.014469:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.014475:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.014480:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.014485:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.014491:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.014495:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.014501:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.014507:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.014512:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.014517:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.014522:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.014527:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.014532:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.014536:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.014541:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.014546:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.014550:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.014554:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.014559:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.014564:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.014569:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.014573:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.014579:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.014584:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.014590:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.014595:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.014600:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.014606:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.014611:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:1.0:1787779681.015087:0:12907:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787779681.015091:0:12907:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:00000080:0.0:1787779681.015965:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98e844cfc800 for MGS 00000020:01000000:1.0:1787779681.016171:0:12907:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff98e845540f60 - data ffff98e87f8ce798/ffff98e87aa51800 00000020:01000000:1.0:1787779681.016314:0:12907:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff98e842c18240 - data ffff98e864f1d438/ffff98e843e1d000 00000020:00000080:1.0:1787779681.016814:0:12907:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9e63ba8af6888c57 00000020:00000080:1.0:1787779681.017073:0:12907:0:(genops.c:885:class_export_put()) final put ffff98e852626800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1787779681.017123:0:12907:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98e846b05800 from MGS, refs=2 00000020:01000004:1.0:1787779681.017127:0:12907:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98e846b05800 2 00000020:01000004:1.0:1787779681.017131:0:12907:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff98e846b05800 from MGS 00000020:00000080:1.0:1787779681.017154:0:12907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787779681.017162:0:12907:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1787779681.017165:0:12907:0:(genops.c:885:class_export_put()) final put ffff98e852623000/MGS 00000020:00000080:1.0:1787779681.017168:0:12907:0:(genops.c:844:class_export_destroy()) destroying export ffff98e852623000/MGS for MGS 00000020:01000000:1.0:1787779681.017175:0:12907:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1787779681.017230:0:12907:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1787779681.017234:0:12907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787779681.017240:0:12907:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787779681.017248:0:12907:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff98e843e06000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787779681.017253:0:12907:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff98e842f199b8) has exports, disconnecting them 00000020:00080000:1.0:1787779681.017258:0:12907:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff98e843e06000), last request at 1787779429 00000020:00000080:1.0:1787779681.017262:0:12907:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9e63ba8af6888d22 00000020:00080000:1.0:1787779681.017273:0:12907:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff98e843e06000): rc 0 00000020:00000080:1.0:1787779681.017277:0:12907:0:(genops.c:885:class_export_put()) final put ffff98e843e06000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1787779681.017589:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff98e852626800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787779681.018536:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff98e843e06000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1787779681.019794:0:12907:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1787779681.019802:0:12907:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787779681.019807:0:12907:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787779681.019814:0:12907:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787779681.020084:0:12907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787779681.020103:0:12907:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1787779681.020110:0:12907:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98e846b05800 1 00000020:00000080:0.0:1787779681.020116:0:12907:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9e63ba8af6888c49 00000020:00000080:0.0:1787779681.020124:0:12907:0:(genops.c:885:class_export_put()) final put ffff98e852625000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787779681.020459:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98e85f5ec800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1787779681.020466:0:38:0:(genops.c:885:class_export_put()) final put ffff98e84726e000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1787779681.020469:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff98e84726e000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1787779681.020475:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000000:0.0:1787779681.020582:0:12907:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1787779681.020587:0:12907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787779681.020592:0:12907:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787779681.020596:0:12907:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff98e844cbb370) has no exports 00000020:00000080:2.0:1787779681.020936:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff98e852625000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787779681.056370:0:12907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787779681.056389:0:12907:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1787779681.056395:0:12907:0:(genops.c:885:class_export_put()) final put ffff98e847258000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787779681.056400:0:12907:0:(genops.c:844:class_export_destroy()) destroying export ffff98e847258000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1787779681.056411:0:12907:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1787779681.056533:0:12907:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff98e846b00000 00000020:01000000:1.0:1787779681.056556:0:12907:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1787779681.056561:0:12907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787779681.056565:0:12907:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787779681.056569:0:12907:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff98e842f1b370) has no exports 00000100:00100000:0.0:1787779681.057001:0:5835:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff98e842f22e00:5835] 0 exiting: rc = 1 00000100:00100000:3.0:1787779681.059488:0:5837:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff98e843e25c00:5837] 2 exiting: rc = 0 00000100:00100000:1.0:1787779681.059805:0:8197:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff98e844c97400:8197] 3 exiting: rc = 0 00000100:00100000:2.0:1787779681.060007:0:5836:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff98e843e25200:5836] 1 exiting: rc = 0 00000100:00100000:1.0:1787779681.060113:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.060136:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.060143:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.060149:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.060155:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.060161:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.060173:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.060207:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.060218:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.060223:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.060228:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.060357:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.060363:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.060367:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.060373:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.060378:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.060385:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.060390:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.060397:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.060402:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.060920:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.060930:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.060936:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.060943:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.060950:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.060955:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.060960:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.060966:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.060971:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.060976:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.060982:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.060987:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.060992:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.060997:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.061002:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.061007:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.061020:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.061025:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.061030:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.061036:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.061042:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.061049:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.061056:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.061063:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.061069:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.061075:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.061080:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.061085:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.061090:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.061094:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.061100:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.061105:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.061111:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.061116:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.061121:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.061126:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.061132:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.061137:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.061145:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.061151:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.061156:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.061161:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.061167:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.061172:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779681.066797:0:11475:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_002: service thread [ffff98e87ec14400:11475] 2 exiting: rc = 0 00000100:00100000:0.0:1787779681.067009:0:5838:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff98e843e25a00:5838] 0 exiting: rc = 1 00000100:00100000:2.0:1787779681.067086:0:5839:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff98e843e24800:5839] 1 exiting: rc = 0 00000100:00100000:1.0:1787779681.067140:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.067151:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.067157:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.067163:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.067169:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.067174:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.067180:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.067197:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.067202:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.067207:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.067214:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.067225:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.067234:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.067240:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.067245:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.067250:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.067255:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.067260:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.067266:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.067271:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.067809:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.067814:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.067819:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.067824:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.067829:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.067835:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.067840:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.067846:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.067850:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.067855:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.067860:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.067866:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.067871:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.067876:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.067895:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.067900:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.067905:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.067910:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.067915:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.067920:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.067926:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.067932:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.067947:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.067952:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.067957:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.067961:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.067967:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.067972:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.067977:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.067981:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.067986:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.067991:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.067995:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.068000:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.068005:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.068010:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.068014:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.068019:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.068024:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.068029:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.068033:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.068037:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.068041:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.068046:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779681.068777:0:5840:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff98e86c69c600:5840] 0 exiting: rc = 1 00000100:00100000:2.0:1787779681.069044:0:5841:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff98e846ac1600:5841] 1 exiting: rc = 0 00000100:00100000:1.0:1787779681.069121:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.069125:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.069129:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.069133:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.069137:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.069142:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.069146:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.069150:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.069154:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.069158:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.069171:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.069175:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.069179:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.069189:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.069193:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.069197:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.069200:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.069204:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.069209:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.069212:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.069216:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.069220:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.069338:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.069345:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.069351:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.069356:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.069360:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.069364:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.069368:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.069372:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.069376:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.069379:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.069383:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.069387:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.069402:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.069406:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.069410:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.069639:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.069645:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.069649:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.069653:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.069660:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.069665:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.069669:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.069673:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.069679:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.069694:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.069698:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.069707:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.069783:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.069790:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.069797:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.069803:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.069807:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.069811:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.069816:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.069819:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.069824:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.069844:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.069854:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.069859:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.069865:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.069871:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.069877:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779681.078576:0:5843:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff98e85f437c00:5843] 1 exiting: rc = 0 00000100:00100000:1.0:1787779681.078577:0:5842:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff98e86c69cc00:5842] 0 exiting: rc = 1 00000100:00100000:1.0:1787779681.079775:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.079783:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.079788:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.079794:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.079799:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.079805:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.079810:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.079815:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.079820:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.079825:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.079830:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.079835:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.079840:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.079846:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.079851:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.079855:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.079860:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.079865:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.079894:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.079900:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.079905:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.079910:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.079915:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.079920:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.079925:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.079930:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.079936:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.079941:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.079945:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.079950:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.079955:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.079960:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.079964:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.079969:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.079974:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.079979:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.079984:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.079989:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.079994:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.079999:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.080004:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.080009:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.080013:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.080018:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.080023:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.080027:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.080032:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.080036:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.080041:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.080046:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.080050:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.080055:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.080059:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.080070:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.080076:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.080081:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.080085:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.080090:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.080095:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.080100:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.080104:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.080109:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.080113:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.080118:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.080640:0:5845:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff98e85f436800:5845] 1 exiting: rc = 0 00000100:00100000:3.0:1787779681.080994:0:5844:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff98e85f437a00:5844] 0 exiting: rc = 1 00000100:00100000:1.0:1787779681.081328:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.081335:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.081340:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.081346:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.081351:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.081355:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.081360:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.081364:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.081369:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.081374:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.081379:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.081384:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.081390:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.081395:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.081400:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.081404:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.081409:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.081469:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.081475:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.081478:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.081482:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.081485:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.081488:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.081498:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.081501:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.081504:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.081507:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.081511:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.081514:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.081517:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.081520:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.081523:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.081526:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.081528:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.081531:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.081535:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.081538:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.081541:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.081544:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.081547:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.081550:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.081553:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.081556:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.081559:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.081561:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.081564:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.081567:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.081570:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.081573:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.081577:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.081579:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.081582:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.081585:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.081588:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.081591:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.081594:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.081597:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.081600:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.081606:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.081609:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.081611:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.081614:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.081617:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.081619:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787779681.082229:0:5847:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff98e85f437400:5847] 1 exiting: rc = 0 00000100:00100000:2.0:1787779681.082352:0:5846:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff98e85f4f9200:5846] 0 exiting: rc = 1 00000100:00100000:0.0:1787779681.082441:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779681.082447:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779681.082452:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779681.082457:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779681.082462:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779681.082468:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779681.082473:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779681.082479:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779681.082483:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779681.082488:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779681.082494:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779681.082505:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779681.082510:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779681.082559:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779681.082564:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779681.082568:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779681.082573:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779681.082577:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779681.082582:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779681.082586:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779681.082598:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779681.082602:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779681.082607:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779681.082611:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779681.082615:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779681.082619:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779681.082624:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779681.082628:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779681.082632:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779681.082636:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779681.082641:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779681.082645:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779681.082649:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779681.082653:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779681.082658:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779681.082661:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779681.082666:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779681.082670:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779681.082674:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779681.082678:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779681.082683:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779681.082687:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779681.082691:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779681.082696:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779681.082705:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779681.082973:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779681.082978:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779681.082983:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779681.082988:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779681.082992:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779681.082997:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779681.083001:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779681.083005:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779681.083010:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779681.083013:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779681.083023:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779681.083027:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779681.083031:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779681.083036:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779681.083040:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779681.083044:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779681.083048:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779681.083053:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779681.083057:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779681.084387:0:5850:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff98e85f583a00:5850] 2 exiting: rc = 0 00000100:00100000:0.0:1787779681.085034:0:5849:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff98e85f583600:5849] 1 exiting: rc = 0 00000100:00100000:1.0:1787779681.085226:0:5848:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff98e842fbd200:5848] 0 exiting: rc = 1 00000100:00100000:2.0:1787779681.085332:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787779681.085350:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787779681.085356:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787779681.085362:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787779681.085367:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787779681.085382:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787779681.085388:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787779681.085395:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787779681.085400:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787779681.085406:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787779681.085411:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787779681.085417:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787779681.085422:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787779681.085428:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787779681.085434:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787779681.085439:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787779681.085445:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787779681.085451:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787779681.085457:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787779681.085462:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787779681.085468:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787779681.085474:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787779681.085479:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787779681.085485:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787779681.085490:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787779681.085508:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787779681.085514:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787779681.085520:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787779681.085526:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787779681.085531:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787779681.085536:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787779681.085542:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787779681.085547:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787779681.085553:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787779681.085560:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787779681.085566:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787779681.085572:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787779681.085577:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787779681.085582:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787779681.085587:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787779681.085597:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787779681.085603:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787779681.085610:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787779681.085615:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787779681.085621:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787779681.085674:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787779681.085682:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787779681.085687:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787779681.085692:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787779681.086492:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787779681.086506:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787779681.086511:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787779681.086516:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787779681.086522:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787779681.086527:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787779681.086532:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787779681.086537:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787779681.086543:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787779681.086549:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787779681.086555:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787779681.086560:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787779681.086565:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787779681.086571:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787779681.086577:0:12907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1787779681.091243:0:12907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787779681.091257:0:12907:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1787779681.091263:0:12907:0:(genops.c:885:class_export_put()) final put ffff98e847cf7800/MDS_uuid 00000020:00000080:2.0:1787779681.091267:0:12907:0:(genops.c:844:class_export_destroy()) destroying export ffff98e847cf7800/MDS_uuid for MDS 00000020:01000000:2.0:1787779681.091272:0:12907:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1787779681.091413:0:12907:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1787779681.907036:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779682.934382:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779683.773475:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e743506d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c28aae66-2825-42c5-8f52-61f687e868c9:3307:1874622525039104:0@lo:400:kworker.0 00000400:00000100:3.0:1787779683.773533:0:3307:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874622525039104 offset 0 length 224: 4 00000100:00100000:3.0:1787779683.773593:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e743506580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874622525039232:0@lo:400:kworker.0 00000400:00000100:3.0:1787779683.773614:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874622525039232 offset 0 length 224: 4 00000100:00100000:3.0:1787779683.773630:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787779683.773636:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e743505e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874622525039360:0@lo:400:kworker.0 00000400:00000100:3.0:1787779683.773651:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874622525039360 offset 0 length 224: 4 00000001:00100000:2.0:1787779683.807584:0:7634:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787779683.807596:0:7634:0:(genops.c:885:class_export_put()) final put ffff98e851765800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787779683.808368:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff98e851765800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1787779683.808437:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98e851766800 for lustre-OST0001 00010000:00010000:1.0:1787779683.968573:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787779684.017436:0:13063:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1787779684.047851:0:13063:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1787779684.047901:0:13063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e882048a00/0x9e63ba8af6888f8a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888f91 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779684.047914:0:13063:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e882048a00/0x9e63ba8af6888f8a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9e63ba8af6888f91 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779684.047921:0:13063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e882048a00/0x9e63ba8af6888f8a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x9e63ba8af6888f91 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779684.047927:0:13063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.109@tcp lock: ffff98e882048a00/0x9e63ba8af6888f8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x9e63ba8af6888f91 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779684.047947:0:13063:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787779684.047952:0:13063:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787779684.047984:0:13063:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787779684.047996:0:13063:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98e743506580 x1874622525039232/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779699 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779684.048027:0:13063:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787779684.048032:0:13063:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787779684.048057:0:13063:0:(import.c:65:import_set_state_nolock()) ffff98e848ee7800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1787779684.048283:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e743506580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874622525039232:0@lo:400:kworker.0 00000100:00100000:1.0:1787779684.048430:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87fdd3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1874622525039488:0@lo:39:umount.0 00000400:00000100:1.0:1787779684.048480:0:3303:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874622525039488 offset 0 length 224: 4 00010000:00010000:2.0:1787779684.048619:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787779684.048627:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff98e882048a00/0x9e63ba8af6888f8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x9e63ba8af6888f91 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779684.048648:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e882048a00 already unused, calling callback (ffffffffc1cd5c20) 10000000:00010000:2.0:1787779684.048651:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff98e882048a00/0x9e63ba8af6888f8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x9e63ba8af6888f91 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779684.048660:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff98e882048a00/0x9e63ba8af6888f8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x9e63ba8af6888f91 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787779684.048668:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff98e882048a00/0x9e63ba8af6888f8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x9e63ba8af6888f91 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787779684.048674:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787779684.048676:0:5825:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787779684.048679:0:5825:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787779684.048708:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.109@tcp lock: ffff98e882048a00/0x9e63ba8af6888f8a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x9e63ba8af6888f91 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779684.048867:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787779684.048885:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff98e882048a00/0x9e63ba8af6888f8a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x9e63ba8af6888f91 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779684.048891:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff98e882048a00/0x9e63ba8af6888f8a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x9e63ba8af6888f91 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779684.048903:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779684.048904:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779684.048906:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779684.049002:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787779684.049013:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e741e6d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c28aae66-2825-42c5-8f52-61f687e868c9:3307:1874622525039616:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787779684.049053:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779684.049250:0:11162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525039616 00000100:00100000:2.0:1787779684.049257:0:11162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525039616 00000100:00100000:2.0:1787779684.049315:0:11162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787779684.049322:0:11162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e743506580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3307:x1874622525039616:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1787779684.049337:0:11162:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787779684 with bad export cookie 11413170986691366003 00000100:00100000:0.0:1787779684.062753:0:11162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e743506580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3307:x1874622525039616:12345-0@lo:103:ldlm_bl.0 Request processed in 13422us (13692us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787779684.062768:0:11162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1787779684.062995:0:3307:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.109@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787779684.063001:0:3307:0:(import.c:65:import_set_state_nolock()) ffff98e847cf0800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1787779684.063004:0:3307:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.109@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1787779684.072663:0:3307:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.109@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1787779684.072671:0:3307:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1787779684.072681:0:3307:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98e743506d00 x1874622525039104/t0(0) o400->MGC192.168.201.109@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787779699 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779684.072696:0:3307:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98e741e6d680 x1874622525039616/t0(0) o103->MGC192.168.201.109@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787779700 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1787779684.072705:0:3307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1787779684.072708:0:3307:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1787779684.072744:0:3307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1787779684.072748:0:3307:0:(import.c:65:import_set_state_nolock()) ffff98e847cf0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787779684.072754:0:3307:0:(import.c:510:import_select_connection()) MGC192.168.201.109@tcp: connect to NID 0@lo last attempt 194 00000100:00080000:2.0:1787779684.072762:0:3307:0:(import.c:624:import_select_connection()) MGC192.168.201.109@tcp: import ffff98e847cf0800 using connection 192.168.201.109@tcp/0@lo 00000100:00100000:2.0:1787779684.072900:0:3307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98e741e6d2c0 x1874622525039744/t0(0) o250->MGC192.168.201.109@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787779684.072946:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e743506d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c28aae66-2825-42c5-8f52-61f687e868c9:3307:1874622525039104:0@lo:400:kworker.0 00000100:00100000:2.0:1787779684.072982:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e741e6d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c28aae66-2825-42c5-8f52-61f687e868c9:3307:1874622525039616:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787779684.074622:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e741e6d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c28aae66-2825-42c5-8f52-61f687e868c9:3303:1874622525039744:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:1.0:1787779684.074680:0:3303:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874622525039744 offset 0 length 520: 4 00010000:00010000:1.0:1787779684.979045:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779686.003080:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779687.031522:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779688.056512:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787779688.883082:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) c28aae66-2825-42c5-8f52-61f687e868c9->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787779688.883094:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) c28aae66-2825-42c5-8f52-61f687e868c9->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787779688.883221:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e743507c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1874622525039872:0@lo:400:kworker.0 00000400:00000100:2.0:1787779688.883277:0:3307:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874622525039872 offset 0 length 224: 4 00010000:00010000:0.0:1787779689.075856:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779690.101293:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779691.122959:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779692.146950:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779693.171100:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787779694.002931:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c28aae66-2825-42c5-8f52-61f687e868c9->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787779694.002943:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) c28aae66-2825-42c5-8f52-61f687e868c9->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787779694.003133:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787779694.003168:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e743504b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874622525040000:0@lo:400:kworker.0 00000400:00000100:2.0:1787779694.003216:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874622525040000 offset 0 length 224: 4 00010000:00010000:1.0:1787779694.196735:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787779694.517556:0:3303:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787779684/real 1787779684] req@ffff98e741e6d2c0 x1874622525039744/t0(0) o250->MGC192.168.201.109@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787779694 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779694.517591:0:3303:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98e741e6d2c0 x1874622525039744/t0(0) o250->MGC192.168.201.109@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787779694 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779694.517602:0:3303:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787779684/real 1787779684] req@ffff98e87fdd3840 x1874622525039488/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787779694 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779694.517613:0:3303:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98e87fdd3840 x1874622525039488/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787779694 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787779694.517631:0:3303:0:(import.c:65:import_set_state_nolock()) ffff98e847cf0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787779694.517667:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1787779694.517672:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e741e6d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c28aae66-2825-42c5-8f52-61f687e868c9:3303:1874622525039744:0@lo:250:ptlrpcd_00_03.0 00000100:00080000:2.0:1787779694.517679:0:3303:0:(import.c:65:import_set_state_nolock()) ffff98e848ee7800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787779694.517695:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87fdd3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1874622525039488:0@lo:39:umount.0 00000100:00080000:0.0:1787779694.517859:0:13063:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787779694.517869:0:13063:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787779694.517877:0:13063:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1787779694.518741:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c28aae66-2825-42c5-8f52-61f687e868c9->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787779694.518748:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1787779694.518752:0:8:0:(import.c:65:import_set_state_nolock()) ffff98e847cf0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787779694.518760:0:8:0:(import.c:510:import_select_connection()) MGC192.168.201.109@tcp: connect to NID 0@lo last attempt 449 00000100:00080000:1.0:1787779694.518765:0:8:0:(import.c:589:import_select_connection()) MGC192.168.201.109@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787779694.518772:0:8:0:(import.c:624:import_select_connection()) MGC192.168.201.109@tcp: import ffff98e847cf0800 using connection 192.168.201.109@tcp/0@lo 00000100:00100000:1.0:1787779694.518808:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98e852b9d2c0 x1874622525040128/t0(0) o250->MGC192.168.201.109@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787779694.518901:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787779694.518918:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e852b9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874622525040256:0@lo:400:kworker.0 00010000:00010000:0.0:1787779694.518954:0:13063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e848f68600/0x9e63ba8af6888f98 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888f9f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779694.518972:0:13063:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e848f68600/0x9e63ba8af6888f98 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9e63ba8af6888f9f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779694.518981:0:13063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e848f68600/0x9e63ba8af6888f98 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x9e63ba8af6888f9f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779694.518989:0:13063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.109@tcp lock: ffff98e848f68600/0x9e63ba8af6888f98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x9e63ba8af6888f9f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000400:00000100:1.0:1787779694.518991:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874622525040256 offset 0 length 224: 4 00010000:00010000:0.0:1787779694.519035:0:13063:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787779694.519045:0:13063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e87aa66800/0x9e63ba8af68891cf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af68891d6 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779694.519071:0:13063:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e87aa66800/0x9e63ba8af68891cf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9e63ba8af68891d6 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779694.519078:0:13063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e87aa66800/0x9e63ba8af68891cf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9e63ba8af68891d6 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779694.519085:0:13063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.109@tcp lock: ffff98e87aa66800/0x9e63ba8af68891cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9e63ba8af68891d6 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779694.519088:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787779694.519102:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff98e848f68600/0x9e63ba8af6888f98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x9e63ba8af6888f9f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779694.519110:0:13063:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787779694.519114:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e848f68600 already unused, calling callback (ffffffffc1cd5c20) 10000000:01000000:0.0:1787779694.519118:0:13063:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 10000000:00010000:1.0:1787779694.519122:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff98e848f68600/0x9e63ba8af6888f98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x9e63ba8af6888f9f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779694.519135:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff98e848f68600/0x9e63ba8af6888f98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x9e63ba8af6888f9f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787779694.519142:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff98e848f68600/0x9e63ba8af6888f98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x9e63ba8af6888f9f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787779694.519148:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787779694.519151:0:5824:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1787779694.519154:0:5824:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00000020:01000004:0.0:1787779694.519156:0:13063:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1787779694.519163:0:13063:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1787779694.519168:0:13063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00010000:00010000:1.0:1787779694.519173:0:5824:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98e847cf0800 00000020:00000080:0.0:1787779694.519178:0:13063:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00010000:00010000:1.0:1787779694.519180:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff98e848f68600/0x9e63ba8af6888f98 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x9e63ba8af6888f9f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787779694.519186:0:13063:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff98e874594d28) has no exports 00010000:00010000:1.0:1787779694.519195:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff98e848f68600/0x9e63ba8af6888f98 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x9e63ba8af6888f9f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779694.519212:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787779694.519216:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff98e87aa66800/0x9e63ba8af68891cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9e63ba8af68891d6 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779694.519223:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87aa66800 already unused, calling callback (ffffffffc1cd5c20) 00000020:00080000:0.0:1787779694.519224:0:13063:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff98e874594d28) has no exports 10000000:00010000:1.0:1787779694.519238:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff98e87aa66800/0x9e63ba8af68891cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9e63ba8af68891d6 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779694.519246:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff98e87aa66800/0x9e63ba8af68891cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x9e63ba8af68891d6 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787779694.519253:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff98e87aa66800/0x9e63ba8af68891cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x9e63ba8af68891d6 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787779694.519259:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787779694.519262:0:5824:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787779694.519264:0:5824:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787779694.519272:0:5824:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98e847cf0800 00010000:00010000:1.0:1787779694.519275:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff98e87aa66800/0x9e63ba8af68891cf lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x9e63ba8af68891d6 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779694.519281:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff98e87aa66800/0x9e63ba8af68891cf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x9e63ba8af68891d6 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779694.519290:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779694.519292:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779694.519294:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779694.519314:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787779694.522764:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e852b9d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c28aae66-2825-42c5-8f52-61f687e868c9:3303:1874622525040128:0@lo:250:kworker.0 00000400:00000100:2.0:1787779694.522825:0:3303:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874622525040128 offset 0 length 520: 4 00000020:01000000:0.0:1787779694.529272:0:13063:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff98e87ec0aae0 - data ffff98e87f983bd0/ffff98e87f4d8800 00000020:01000000:0.0:1787779694.530465:0:13063:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff98e742bd3ba0 - data ffff98e84403aa20/ffff98e87ed44800 00100000:10000000:0.0:1787779694.541492:0:13063:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1787779694.567601:0:13063:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9e63ba8af6888da7 00000020:00000080:2.0:1787779694.567616:0:13063:0:(genops.c:885:class_export_put()) final put ffff98e87edcb800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1787779694.567651:0:13063:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98e848ee5800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1787779694.567656:0:13063:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98e848ee5800 2 00000020:01000004:2.0:1787779694.567661:0:13063:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff98e848ee5800 from lustre-OST0000 00000020:00000080:2.0:1787779694.567695:0:13063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787779694.567741:0:13063:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1787779694.567764:0:13063:0:(genops.c:885:class_export_put()) final put ffff98e87edca800/lustre-OST0000_UUID 00000020:00000080:2.0:1787779694.567768:0:13063:0:(genops.c:844:class_export_destroy()) destroying export ffff98e87edca800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1787779694.567777:0:13063:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1787779694.567847:0:13063:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1787779694.567853:0:13063:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1787779694.567857:0:13063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787779694.567864:0:13063:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787779694.567872:0:13063:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff98e87ed82000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787779694.567880:0:13063:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff98e87f03b370) has exports, disconnecting them 00000020:00080000:2.0:1787779694.567886:0:13063:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff98e87ed82000), last request at 1787779448 00000020:00000080:2.0:1787779694.567891:0:13063:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9e63ba8af6888dd1 00000020:00080000:2.0:1787779694.567901:0:13063:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff98e87ed82000): rc 0 00000020:00000080:2.0:1787779694.567907:0:13063:0:(genops.c:885:class_export_put()) final put ffff98e87ed82000/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1787779694.568819:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff98e87edcb800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1787779694.568844:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff98e87ed82000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1787779694.569856:0:13063:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1787779694.569865:0:13063:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787779694.569870:0:13063:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787779694.569879:0:13063:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787779694.570095:0:13063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787779694.570105:0:13063:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:3.0:1787779694.570124:0:13063:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98e848ee5800 1 00000020:00000080:3.0:1787779694.570131:0:13063:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9e63ba8af6888d61 00000020:00000080:3.0:1787779694.570141:0:13063:0:(genops.c:885:class_export_put()) final put ffff98e848ee1800/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1787779694.570147:0:13063:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1787779694.570152:0:13063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787779694.570157:0:13063:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787779694.570160:0:13063:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff98e848ef0000) has no exports 00000020:00000080:0.0:1787779694.570404:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98e848ee7800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1787779694.570413:0:8:0:(genops.c:885:class_export_put()) final put ffff98e87ed83000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1787779694.570416:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff98e87ed83000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1787779694.570427:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1787779694.570500:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff98e848ee1800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1787779694.589745:0:13063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787779694.589768:0:13063:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1787779694.589776:0:13063:0:(genops.c:885:class_export_put()) final put ffff98e848ee5000/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1787779694.589782:0:13063:0:(genops.c:844:class_export_destroy()) destroying export ffff98e848ee5000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1787779694.589790:0:13063:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1787779694.589994:0:13063:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff98e848ee1000 00000020:02000400:3.0:1787779694.590062:0:13063:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1787779695.219947:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779696.243148:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787779697.205624:0:13215:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1787779697.242690:0:13215:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1787779697.242812:0:13215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e841648a00/0x9e63ba8af6888f6e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888f75 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779697.242826:0:13215:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e841648a00/0x9e63ba8af6888f6e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9e63ba8af6888f75 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779697.242833:0:13215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e841648a00/0x9e63ba8af6888f6e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9e63ba8af6888f75 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779697.242839:0:13215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.109@tcp lock: ffff98e841648a00/0x9e63ba8af6888f6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9e63ba8af6888f75 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779697.242861:0:13215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787779697.242867:0:13215:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1787779697.242890:0:13215:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787779697.242901:0:13215:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98e743505e00 x1874622525039360/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779699 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779697.242937:0:13215:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98e743507c00 x1874622525039872/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779704 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779697.242950:0:13215:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98e743504b40 x1874622525040000/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779710 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779697.242960:0:13215:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98e852b9c000 x1874622525040256/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779710 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779697.242966:0:13215:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:2.0:1787779697.242996:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e743507c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1874622525039872:0@lo:400:kworker.0 00000100:00080000:2.0:1787779697.243023:0:13215:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787779697.243047:0:13215:0:(import.c:65:import_set_state_nolock()) ffff98e87a9f6000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1787779697.243071:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e741e6d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1874622525040384:0@lo:39:umount.0 00000400:00000100:2.0:1787779697.243118:0:3303:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874622525040384 offset 0 length 224: 4 00000100:00100000:2.0:1787779697.243197:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e852b9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874622525040256:0@lo:400:kworker.0 00000100:00100000:2.0:1787779697.243204:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e743505e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874622525039360:0@lo:400:kworker.0 00010000:00010000:0.0:1787779697.243404:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787779697.243413:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff98e841648a00/0x9e63ba8af6888f6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9e63ba8af6888f75 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779697.243437:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e841648a00 already unused, calling callback (ffffffffc1cd5c20) 10000000:00010000:0.0:1787779697.243442:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff98e841648a00/0x9e63ba8af6888f6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9e63ba8af6888f75 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779697.243451:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff98e841648a00/0x9e63ba8af6888f6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9e63ba8af6888f75 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787779697.243458:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff98e841648a00/0x9e63ba8af6888f6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9e63ba8af6888f75 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787779697.243463:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787779697.243466:0:5825:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787779697.243468:0:5825:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787779697.243482:0:5825:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98e847cf0800 00010000:00010000:0.0:1787779697.243486:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff98e841648a00/0x9e63ba8af6888f6e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9e63ba8af6888f75 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779697.243493:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff98e841648a00/0x9e63ba8af6888f6e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9e63ba8af6888f75 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779697.243504:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779697.243506:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779697.243508:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779697.243694:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e743504b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874622525040000:0@lo:400:kworker.0 00010000:00010000:1.0:1787779697.273121:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779698.291051:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779699.317811:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787779699.635172:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) c28aae66-2825-42c5-8f52-61f687e868c9->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787779699.635183:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) c28aae66-2825-42c5-8f52-61f687e868c9->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1787779700.338969:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779701.363078:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779702.387056:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779703.411095:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779704.435194:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787779704.755040:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) c28aae66-2825-42c5-8f52-61f687e868c9->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787779704.755067:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) c28aae66-2825-42c5-8f52-61f687e868c9->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1787779705.460045:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779706.483169:0:8500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787779707.442866:0:3303:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787779697/real 1787779697] req@ffff98e741e6d2c0 x1874622525040384/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787779707 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779707.442913:0:3303:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98e741e6d2c0 x1874622525040384/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787779707 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787779707.442940:0:3303:0:(import.c:65:import_set_state_nolock()) ffff98e87a9f6000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787779707.442965:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e741e6d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1874622525040384:0@lo:39:umount.0 00000100:00080000:0.0:1787779707.443008:0:13215:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787779707.443013:0:13215:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787779707.443018:0:13215:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787779707.445104:0:13215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e848f69400/0x9e63ba8af6888f7c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6888f83 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779707.445815:0:13215:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e848f69400/0x9e63ba8af6888f7c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9e63ba8af6888f83 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779707.445828:0:13215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e848f69400/0x9e63ba8af6888f7c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9e63ba8af6888f83 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779707.445835:0:13215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.109@tcp lock: ffff98e848f69400/0x9e63ba8af6888f7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9e63ba8af6888f83 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779707.445868:0:13215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787779707.445875:0:13215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e8429d5a00/0x9e63ba8af68891c1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af68891c8 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779707.445881:0:13215:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e8429d5a00/0x9e63ba8af68891c1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9e63ba8af68891c8 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779707.445887:0:13215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e8429d5a00/0x9e63ba8af68891c1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9e63ba8af68891c8 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779707.445893:0:13215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.109@tcp lock: ffff98e8429d5a00/0x9e63ba8af68891c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9e63ba8af68891c8 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779707.445919:0:13215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1787779707.445924:0:13215:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1787779707.445949:0:13215:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1787779707.445953:0:13215:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1787779707.445959:0:13215:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787779707.445965:0:13215:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787779707.445983:0:13215:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff98e873b04d28) has no exports 00000020:00080000:0.0:1787779707.446007:0:13215:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff98e873b04d28) has no exports 00010000:00010000:1.0:1787779707.446187:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787779707.446195:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff98e848f69400/0x9e63ba8af6888f7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9e63ba8af6888f83 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779707.446203:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e848f69400 already unused, calling callback (ffffffffc1cd5c20) 10000000:00010000:1.0:1787779707.446206:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff98e848f69400/0x9e63ba8af6888f7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9e63ba8af6888f83 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779707.446216:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff98e848f69400/0x9e63ba8af6888f7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x9e63ba8af6888f83 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787779707.446223:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff98e848f69400/0x9e63ba8af6888f7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x9e63ba8af6888f83 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787779707.446228:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787779707.446230:0:5824:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:1.0:1787779707.446233:0:5824:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:1.0:1787779707.446246:0:5824:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98e847cf0800 00010000:00010000:1.0:1787779707.446250:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff98e848f69400/0x9e63ba8af6888f7c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x9e63ba8af6888f83 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779707.446257:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff98e848f69400/0x9e63ba8af6888f7c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x9e63ba8af6888f83 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779707.446271:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787779707.446275:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff98e8429d5a00/0x9e63ba8af68891c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9e63ba8af68891c8 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779707.446295:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e8429d5a00 already unused, calling callback (ffffffffc1cd5c20) 10000000:00010000:1.0:1787779707.446298:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff98e8429d5a00/0x9e63ba8af68891c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9e63ba8af68891c8 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779707.446305:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff98e8429d5a00/0x9e63ba8af68891c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9e63ba8af68891c8 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787779707.446310:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff98e8429d5a00/0x9e63ba8af68891c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9e63ba8af68891c8 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787779707.446314:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787779707.446316:0:5824:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787779707.446317:0:5824:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787779707.446325:0:5824:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98e847cf0800 00010000:00010000:1.0:1787779707.446328:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff98e8429d5a00/0x9e63ba8af68891c1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x9e63ba8af68891c8 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779707.446333:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff98e8429d5a00/0x9e63ba8af68891c1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x9e63ba8af68891c8 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779707.446344:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779707.446346:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779707.446348:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779707.446410:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1787779707.452767:0:13215:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff98e87ec0a4e0 - data ffff98e87f9836c0/ffff98e87ab15400 00000020:01000000:0.0:1787779707.452893:0:13215:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff98e8744205a0 - data ffff98e864fea360/ffff98e87f695400 00100000:10000000:0.0:1787779707.463307:0:13215:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1787779707.493849:0:13215:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9e63ba8af6888e72 00000020:00000080:1.0:1787779707.493859:0:13215:0:(genops.c:885:class_export_put()) final put ffff98e87edcb000/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1787779707.493874:0:13215:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98e87a56c800 from lustre-OST0001, refs=2 00000020:01000004:1.0:1787779707.493877:0:13215:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98e87a56c800 2 00000020:01000004:1.0:1787779707.493880:0:13215:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff98e87a56c800 from lustre-OST0001 00000020:00000080:0.0:1787779707.494132:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98e87edcb000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1787779707.494426:0:13215:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787779707.494450:0:13215:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1787779707.494454:0:13215:0:(genops.c:885:class_export_put()) final put ffff98e87ed81800/lustre-OST0001_UUID 00000020:00000080:1.0:1787779707.494457:0:13215:0:(genops.c:844:class_export_destroy()) destroying export ffff98e87ed81800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1787779707.494463:0:13215:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1787779707.494568:0:13215:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import c28aae66-2825-42c5-8f52-61f687e868c9->MGS 00010000:00010000:1.0:1787779707.494585:0:13215:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff98e841648800/0x9e63ba8af6888d84 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9e63ba8af6888d8b expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787779707.494690:0:13215:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff98e841648800/0x9e63ba8af6888d84 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9e63ba8af6888d8b expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787779707.494698:0:13215:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1787779707.494701:0:13215:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1787779707.494705:0:13215:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1787779707.494748:0:13215:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98e847cf0800 00010000:00010000:1.0:1787779707.494752:0:13215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff98e841648800/0x9e63ba8af6888d84 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9e63ba8af6888d8b expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779707.494768:0:13215:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff98e87a98b000/0x9e63ba8af6888fc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9e63ba8af6888fc9 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787779707.494774:0:13215:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff98e87a98b000/0x9e63ba8af6888fc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9e63ba8af6888fc9 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787779707.494780:0:13215:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787779707.494782:0:13215:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1787779707.494784:0:13215:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1787779707.494793:0:13215:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98e847cf0800 00010000:00010000:1.0:1787779707.494795:0:13215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff98e87a98b000/0x9e63ba8af6888fc2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9e63ba8af6888fc9 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787779707.494811:0:13215:0:(import.c:65:import_set_state_nolock()) ffff98e847cf0800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1787779707.494823:0:13215:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1787779707.494826:0:13215:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1787779707.494827:0:13215:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1787779707.494832:0:13215:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1787779707.494843:0:13215:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98e852b9d2c0 x1874622525040128/t0(0) o250->MGC192.168.201.109@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787779709 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1787779707.494856:0:13215:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1787779707.494858:0:13215:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00000100:00100000:3.0:1787779707.494954:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e852b9d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c28aae66-2825-42c5-8f52-61f687e868c9:3303:1874622525040128:0@lo:250:kworker.0 10000000:01000000:1.0:1787779707.495017:0:13215:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1787779707.495026:0:13215:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9e63ba8af6888c65 00000020:00000080:1.0:1787779707.495030:0:13215:0:(genops.c:885:class_export_put()) final put ffff98e847cf0000/c28aae66-2825-42c5-8f52-61f687e868c9 00000020:01000000:1.0:1787779707.495043:0:13215:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.201.109@tcp (flags='') 00000020:00000080:1.0:1787779707.495048:0:13215:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787779707.495052:0:13215:0:(obd_config.c:956:class_cleanup()) MGC192.168.201.109@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787779707.495056:0:13215:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff98e842f18000) has no exports 10000000:01000000:3.0:1787779707.495111:0:5833:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1787779707.495315:0:13215:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.201.109@tcp: client import never connected 00000100:00080000:1.0:1787779707.495318:0:13215:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1787779707.495320:0:13215:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1787779707.495322:0:13215:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1787779707.495323:0:13215:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1787779707.495357:0:13215:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787779707.495373:0:13215:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.109@tcp (uuid c28aae66-2825-42c5-8f52-61f687e868c9) 00000020:01000000:1.0:1787779707.495379:0:13215:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1787779707.495383:0:13215:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787779707.495387:0:13215:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787779707.495391:0:13215:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff98e851765000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787779707.495397:0:13215:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff98e844cbcd28) has exports, disconnecting them 00000020:00080000:1.0:1787779707.495401:0:13215:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff98e851765000), last request at 1787779469 00000020:00000080:1.0:1787779707.495404:0:13215:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9e63ba8af6888e9c 00000020:00080000:1.0:1787779707.495415:0:13215:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff98e851765000): rc 0 00000020:00000080:1.0:1787779707.495427:0:13215:0:(genops.c:885:class_export_put()) final put ffff98e851765000/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1787779707.496630:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98e847cf0000/c28aae66-2825-42c5-8f52-61f687e868c9 for MGC192.168.201.109@tcp 00000020:00000080:0.0:1787779707.496643:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98e847cf0800 for MGC192.168.201.109@tcp 00000020:00000080:0.0:1787779707.496649:0:36:0:(genops.c:885:class_export_put()) final put ffff98e847cf4000/c28aae66-2825-42c5-8f52-61f687e868c9 00000020:00000080:0.0:1787779707.496651:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98e847cf4000/c28aae66-2825-42c5-8f52-61f687e868c9 for MGC192.168.201.109@tcp 00000020:01000000:0.0:1787779707.496655:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.109@tcp (c28aae66-2825-42c5-8f52-61f687e868c9) 00000020:00000080:0.0:1787779707.496936:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98e851765000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1787779707.497785:0:13215:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1787779707.497792:0:13215:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787779707.497796:0:13215:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787779707.497802:0:13215:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787779707.497858:0:8500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1787779707.498134:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000020:00000080:3.0:1787779707.498258:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98e87a9f6000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:3.0:1787779707.498377:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:3.0:1787779707.498813:0:5819:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff98e846ac1800:5819] 0 exiting: rc = 1 00000100:00100000:0.0:1787779707.500795:0:5820:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff98e848ed0000:5820] 1 exiting: rc = 0 00000100:00100000:3.0:1787779707.500966:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.501221:0:5822:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff98e8500aea00:5822] 1 exiting: rc = 0 00000100:00100000:3.0:1787779707.501272:0:5823:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff98e847486e00:5823] 2 exiting: rc = 0 00000100:00100000:0.0:1787779707.501372:0:5821:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff98e8500aee00:5821] 0 exiting: rc = 1 00000100:00100000:0.0:1787779707.501437:0:11162:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff98e87f6d0400:11162] 3 exiting: rc = 0 00000100:00100000:3.0:1787779707.501634:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.501643:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.501650:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.501656:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.501662:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.501668:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.501674:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.501681:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.501703:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.501708:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.501746:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.501751:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.501757:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.501763:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.501769:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.501776:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.501782:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.501787:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.501792:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.501797:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.501801:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.501807:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.501812:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.501817:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.501822:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.501827:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.501832:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.501837:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.501841:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.501846:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.501850:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.501856:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.501863:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.501868:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.501873:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.501878:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.501883:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.501888:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.501893:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.501898:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.501903:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.501908:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.501914:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.501927:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.501932:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.501937:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.501941:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.501946:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.501951:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.501955:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.501960:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.501966:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.501971:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.501975:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.501980:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.501985:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.501990:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.501995:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.501999:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.502004:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.502009:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.502014:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.502018:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.502023:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1787779707.503239:0:13215:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787779707.503248:0:13215:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1787779707.503253:0:13215:0:(genops.c:885:class_export_put()) final put ffff98e85f570800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1787779707.503257:0:13215:0:(genops.c:844:class_export_destroy()) destroying export ffff98e85f570800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1787779707.503263:0:13215:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:3.0:1787779707.503304:0:13215:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98e87a56c800 1 00000020:00000080:3.0:1787779707.503311:0:13215:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9e63ba8af6888e41 00000020:00000080:3.0:1787779707.503318:0:13215:0:(genops.c:885:class_export_put()) final put ffff98e87ed81000/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1787779707.503337:0:13215:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1787779707.503342:0:13215:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787779707.503346:0:13215:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787779707.503350:0:13215:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff98e844cb99b8) has no exports 00000020:00000080:0.0:1787779707.503489:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98e87ed81000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1787779707.527827:0:13215:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787779707.527857:0:13215:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1787779707.527865:0:13215:0:(genops.c:885:class_export_put()) final put ffff98e87a56b800/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1787779707.527870:0:13215:0:(genops.c:844:class_export_destroy()) destroying export ffff98e87a56b800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1787779707.528064:0:13215:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1787779707.528528:0:13215:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff98e87a56f800 00000020:01000000:3.0:1787779707.528552:0:13215:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1787779707.528558:0:13215:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787779707.528563:0:13215:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787779707.528567:0:13215:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff98e848ef3370) has no exports 00000020:00000080:3.0:1787779707.528593:0:13215:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787779707.528744:0:13215:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1787779707.528749:0:13215:0:(genops.c:885:class_export_put()) final put ffff98e848ee2800/OSS_uuid 00000020:00000080:3.0:1787779707.528752:0:13215:0:(genops.c:844:class_export_destroy()) destroying export ffff98e848ee2800/OSS_uuid for OSS 00000020:01000000:3.0:1787779707.528756:0:13215:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:3.0:1787779707.528834:0:6680:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff98e8742a0400:6680] 0 exiting: rc = 1 00000100:00100000:1.0:1787779707.529784:0:6682:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff98e8742a1600:6682] 2 exiting: rc = 0 00000100:00100000:1.0:1787779707.529843:0:10229:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff98e87f016600:10229] 3 exiting: rc = 0 00000100:00100000:1.0:1787779707.529916:0:6681:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff98e844c8c400:6681] 1 exiting: rc = 0 00000100:00100000:3.0:1787779707.530072:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.530081:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.530088:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.530095:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.530101:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.530107:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.530113:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.530118:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.530123:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.530130:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.530136:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.530141:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.530146:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.530151:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.530155:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.530161:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.530166:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.530184:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.530189:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.530207:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.530212:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.530217:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.530223:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.530227:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.530232:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.530238:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.530243:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.530249:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.530254:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.530259:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.530264:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.530269:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.530274:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.530278:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.530283:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.530288:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.530292:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.530296:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.530300:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.530305:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.530309:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.530313:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.530319:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.530324:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.530329:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.530334:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.530339:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.530344:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.530348:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.530352:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.530357:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.530374:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.530380:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.530384:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.530398:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.530402:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.530407:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.530413:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.530427:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.530432:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.530437:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.530446:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.530452:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.530457:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00080000:3.0:1787779707.531875:0:5832:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1787779707.532549:0:6684:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff98e874423a00:6684] 1 exiting: rc = 0 00000100:00100000:1.0:1787779707.535138:0:6683:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff98e874422400:6683] 0 exiting: rc = 1 00000100:00100000:3.0:1787779707.536539:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.536550:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.536555:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.536562:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.536567:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.536573:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.536578:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.536584:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.536589:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.536606:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.536611:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.536617:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.536623:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.536628:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.536633:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.536639:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.536644:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.536648:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.536654:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.536659:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.536664:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.536670:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.536675:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.536679:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.536701:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.536707:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.536730:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.536735:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.536740:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.536745:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.536750:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.536756:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.536762:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.536767:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.536772:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.536777:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.536782:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.536787:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.536792:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.536797:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.536801:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.536806:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.536812:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.536816:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.536822:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.536826:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.536831:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.536837:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.536842:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.536846:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.536851:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.536856:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.536862:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.536866:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.536871:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.536876:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.536881:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.536902:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.536908:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.536921:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.536926:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.536931:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.536936:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.536950:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.539111:0:6687:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff98e842fbb200:6687] 2 exiting: rc = 0 00000100:00100000:0.0:1787779707.540085:0:6686:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff98e842fba000:6686] 1 exiting: rc = 0 00000100:00100000:3.0:1787779707.542312:0:6685:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff98e842fba200:6685] 0 exiting: rc = 1 00000100:00100000:0.0:1787779707.542555:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.542563:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.542570:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.542577:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.542609:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.542617:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.542644:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.542652:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.542657:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.542662:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.542667:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.542673:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.542678:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.542684:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.542689:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.542694:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.542699:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.542705:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.542739:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.542747:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.542752:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.542757:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.542763:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.542769:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.542775:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.542780:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.542786:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.542791:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.542797:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.542802:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.542822:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.542829:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.542845:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.542851:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.542856:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.542862:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.542867:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.542873:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.542879:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.543448:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.543454:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.543459:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.543464:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.543470:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.543476:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.543482:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.543488:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.543494:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.543499:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.543504:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.543510:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.543515:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.543520:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.543525:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.543561:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.543568:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.543574:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.543581:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.543588:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.543603:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.543610:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.543616:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.543622:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.543629:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.552615:0:6688:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff98e842fbae00:6688] 0 exiting: rc = 1 00000100:00100000:3.0:1787779707.555832:0:6689:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff98e85fd9ea00:6689] 1 exiting: rc = 0 00000100:00100000:0.0:1787779707.556118:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.556126:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.556132:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.556137:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.556141:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.556146:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.556151:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.556157:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.556161:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.556166:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.556194:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.556199:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.556204:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.556209:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.556214:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.556219:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.556224:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.556229:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.556235:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.556240:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.556245:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.556251:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.556256:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.556262:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.556267:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.556271:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.556276:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.556281:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.556286:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.556291:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.556297:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.556301:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.556306:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.556311:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.556316:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.556321:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.556325:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.556330:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.556335:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.556339:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.556344:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.556349:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.556353:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.556358:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.556374:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.556388:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.556393:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.556398:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.556403:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.556408:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.556413:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.556427:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.556433:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.556438:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.556443:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.556449:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.556454:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.556459:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.556464:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.556469:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.556475:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.556480:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.556485:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.556490:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787779707.557598:0:6690:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff98e85fdc3a00:6690] 0 exiting: rc = 1 00000100:00100000:3.0:1787779707.557682:0:6691:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff98e8742a2c00:6691] 1 exiting: rc = 0 00000100:00100000:0.0:1787779707.558135:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.558143:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.558158:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.558166:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.558184:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.558190:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.558195:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.558215:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.558223:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.558229:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.558234:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.558240:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.558246:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.558252:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.558257:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.558264:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.558281:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.558287:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.558293:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.558313:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.558320:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.558325:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.558331:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.558336:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.558342:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.558348:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.558354:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.558576:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.558590:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.558606:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.558619:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.558641:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.558647:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.558653:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.558658:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.558665:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.558670:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.558676:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.558681:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.558687:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.558693:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.558698:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.558704:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.558753:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.558762:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.558767:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.558772:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.558778:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.558784:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.558789:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.558795:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.558809:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.558814:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.558820:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.558826:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.558848:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.558855:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.558861:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.558866:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.558872:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.558878:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.559156:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.559165:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787779707.559187:0:13215:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1787779707.572500:0:13215:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1787779727.528539:0:13831:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg109-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1787779736.980789:0:14291:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787779736.980795:0:14291:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1787779736.980939:0:14291:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff98e87f66b000 00000020:01000004:1.0:1787779736.980963:0:14291:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1787779736.980971:0:14291:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1787779736.980986:0:14291:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff98e842f18000) 00000020:00000080:1.0:1787779736.981001:0:14291:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787779737.006982:0:14291:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1787779737.010460:0:14291:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1787779737.011216:0:14291:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 519: rc = 0 00100000:10000000:2.0:1787779737.011388:0:14291:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 519: rc = 0 00100000:10000000:2.0:1787779737.011499:0:14291:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 519: rc = 0 00100000:10000000:2.0:1787779737.011729:0:14291:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 519: rc = 0 00100000:10000000:2.0:1787779737.011820:0:14291:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 519: rc = 0 00100000:10000000:2.0:1787779737.012228:0:14291:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1787779737.012369:0:14291:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 519: rc = 0 00100000:10000000:2.0:1787779737.012799:0:14291:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 521: rc = 0 00100000:10000000:2.0:1787779737.014329:0:14291:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 430: rc = 0 00100000:10000000:2.0:1787779737.014429:0:14291:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 430: rc = 0 00100000:10000000:2.0:1787779737.015272:0:14291:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 632: rc = 0 00100000:10000000:2.0:1787779737.015704:0:14291:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 632: rc = 0 00100000:10000000:2.0:1787779737.016157:0:14291:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 632: rc = 0 00100000:10000000:2.0:1787779737.016596:0:14291:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 632: rc = 0 00100000:10000000:2.0:1787779737.017010:0:14291:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 632: rc = 0 00100000:10000000:2.0:1787779737.017421:0:14291:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 632: rc = 0 00100000:10000000:2.0:1787779737.017924:0:14291:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 632: rc = 0 00100000:10000000:2.0:1787779737.018249:0:14291:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 632: rc = 0 00100000:10000000:2.0:1787779737.018734:0:14291:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 632: rc = 0 00100000:10000000:2.0:1787779737.019152:0:14291:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 632: rc = 0 00100000:10000000:2.0:1787779737.019429:0:14291:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 632: rc = 0 00100000:10000000:2.0:1787779737.019694:0:14291:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 632: rc = 0 00100000:10000000:2.0:1787779737.020601:0:14291:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 637: rc = 0 00100000:10000000:2.0:1787779737.021764:0:14291:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 637: rc = 0 00100000:10000000:2.0:1787779737.022270:0:14291:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 637: rc = 0 00100000:10000000:2.0:1787779737.022839:0:14291:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 637: rc = 0 00100000:10000000:2.0:1787779737.023422:0:14291:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 637: rc = 0 00100000:10000000:2.0:1787779737.024021:0:14291:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 637: rc = 0 00100000:10000000:2.0:1787779737.024455:0:14291:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 637: rc = 0 00100000:10000000:2.0:1787779737.025155:0:14291:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 637: rc = 0 00100000:10000000:2.0:1787779737.025471:0:14291:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 637: rc = 0 00100000:10000000:2.0:1787779737.026117:0:14291:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 637: rc = 0 00100000:10000000:2.0:1787779737.026617:0:14291:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 637: rc = 0 00100000:10000000:2.0:1787779737.027199:0:14291:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 637: rc = 0 00100000:10000000:2.0:1787779737.027621:0:14291:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 637: rc = 0 00100000:10000000:2.0:1787779737.028181:0:14291:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 637: rc = 0 00100000:10000000:2.0:1787779737.028622:0:14291:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 637: rc = 0 00100000:10000000:2.0:1787779737.029202:0:14291:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 637: rc = 0 00100000:10000000:2.0:1787779737.029674:0:14291:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 637: rc = 0 00100000:10000000:2.0:1787779737.030210:0:14291:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 637: rc = 0 00100000:10000000:2.0:1787779737.030668:0:14291:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 637: rc = 0 00100000:10000000:2.0:1787779737.031434:0:14291:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 637: rc = 0 00100000:10000000:2.0:1787779737.031833:0:14291:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 637: rc = 0 00100000:10000000:2.0:1787779737.033188:0:14291:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 637: rc = 0 00100000:10000000:2.0:1787779737.033652:0:14291:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 637: rc = 0 00100000:10000000:2.0:1787779737.034164:0:14291:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 637: rc = 0 00100000:10000000:2.0:1787779737.034597:0:14291:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 637: rc = 0 00100000:10000000:2.0:1787779737.035217:0:14291:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 637: rc = 0 00100000:10000000:2.0:1787779737.035669:0:14291:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 637: rc = 0 00100000:10000000:2.0:1787779737.036209:0:14291:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 637: rc = 0 00100000:10000000:2.0:1787779737.036664:0:14291:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 637: rc = 0 00100000:10000000:2.0:1787779737.037820:0:14291:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 637: rc = 0 00100000:10000000:2.0:1787779737.038398:0:14291:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 637: rc = 0 00100000:10000000:2.0:1787779737.039170:0:14291:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 637: rc = 0 00100000:10000000:2.0:1787779737.039785:0:14291:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 440: rc = 0 00100000:10000000:2.0:1787779737.040924:0:14291:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1787779737.041362:0:14291:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 431: rc = 0 00100000:10000000:2.0:1787779737.041667:0:14291:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1787779737.041764:0:14291:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 431: rc = 0 00100000:10000000:2.0:1787779737.041990:0:14291:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1787779737.042067:0:14291:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 431: rc = 0 00100000:10000000:2.0:1787779737.042422:0:14291:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1787779737.042491:0:14291:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 434: rc = 0 00100000:10000000:2.0:1787779737.043426:0:14291:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1787779737.043609:0:14291:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 434: rc = 0 00100000:10000000:2.0:1787779737.043815:0:14291:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1787779737.044113:0:14291:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 434: rc = 0 00000020:00000080:2.0:1787779737.044672:0:14291:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1787779737.044680:0:14291:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787779737.044689:0:14291:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9e63ba8af6889f66 00000020:01000004:2.0:1787779737.044697:0:14291:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1787779737.044703:0:14291:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1787779737.044708:0:14291:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98e87f66b000 from MGS 00000020:01000004:2.0:1787779737.044746:0:14291:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1787779737.044756:0:14291:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff98e844cb8000) 00000020:00000080:2.0:1787779737.044766:0:14291:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1787779737.044814:0:14291:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98e87f66b000 from MGS, refs=2 00080000:01000000:2.0:1787779737.044825:0:14291:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787779737.044830:0:14291:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9e63ba8af6889f74 00000100:00100000:2.0:1787779737.045373:0:14291:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1787779737.045622:0:14291:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1787779737.045628:0:14291:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1787779737.046647:0:14291:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1787779737.046655:0:14291:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1787779737.047769:0:14291:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787779737.048227:0:14291:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1787779737.048233:0:14291:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1787779737.050607:0:14291:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1787779737.050620:0:14291:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1787779737.051386:0:14291:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1787779737.051394:0:14291:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1787779737.052234:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779737.052238:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779737.052239:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779737.052856:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779737.052859:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779737.052861:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779737.053446:0:14291:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1787779737.061631:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1787779737.063396:0:14291:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1787779737.063414:0:14291:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787779737.063417:0:14291:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1787779737.065750:0:14300:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1787779737.066091:0:14291:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1787779737.066194:0:14291:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787779737.067187:0:14291:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1787779737.067482:0:14291:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787779737.069022:0:14291:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1787779737.069029:0:14291:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1787779737.073293:0:14291:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1787779737.073308:0:14291:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1787779737.076496:0:14291:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1787779737.076507:0:14291:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1787779737.077391:0:14291:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1787779737.077416:0:14291:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.109@tcp' 00000020:01000004:0.0:1787779737.077418:0:14291:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1787779737.077447:0:14291:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.109@tcp (typ=mgc) 00000020:00000080:0.0:1787779737.077460:0:14291:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.109@tcp (ffff98e87f03b370) 00000020:00000080:0.0:1787779737.077476:0:14291:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1787779737.077619:0:14291:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98e743448800@MGC192.168.201.109@tcp: add connection 192.168.201.109@tcp at head 00010000:00010000:0.0:1787779737.077834:0:14291:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.109@tcp-0 is initialized 00000040:01000000:0.0:1787779737.077841:0:14291:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.109@tcp ctxt 1 is initialized 00000100:00080000:3.0:1787779737.078022:0:14305:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1787779737.078477:0:14306:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1787779737.078606:0:14291:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.109@tcp (uuid cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105) 00000020:00000080:0.0:1787779737.078623:0:14291:0:(genops.c:1385:class_connect()) connect: client cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105, cookie 0x9e63ba8af6889f82 00000100:00080000:0.0:1787779737.078635:0:14291:0:(import.c:510:import_select_connection()) MGC192.168.201.109@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787779737.078642:0:14291:0:(import.c:624:import_select_connection()) MGC192.168.201.109@tcp: import ffff98e743448800 using connection 192.168.201.109@tcp/0@lo 00000100:00100000:0.0:1787779737.078670:0:14291:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98e87fdd1a40 x1874622525040512/t0(0) o250->MGC192.168.201.109@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787779737.078695:0:14291:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105->MGS 00000020:01000004:0.0:1787779737.078759:0:14291:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1787779737.078764:0:14291:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1787779737.078774:0:14291:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff98e87f03cd28) 00000020:00000080:0.0:1787779737.078783:0:14291:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1787779737.079028:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87fdd1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:3303:1874622525040512:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1787779737.079094:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779737.079192:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525040512 00000100:00100000:1.0:1787779737.079200:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525040512 00000100:00100000:1.0:1787779737.079229:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787779737.079236:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e84762a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3303:x1874622525040512:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1787779737.079258:0:14301:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105@0@lo t0 exp 0000000000000000 cur 502 last 0 00000020:00000080:1.0:1787779737.079277:0:14301:0:(genops.c:1385:class_connect()) connect: client cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105, cookie 0x9e63ba8af6889f90 00000100:00080000:1.0:1787779737.079389:0:14301:0:(import.c:65:import_set_state_nolock()) ffff98e86c684000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787779737.079445:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e84762a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+5:3303:x1874622525040512:12345-0@lo:250:mount.lustre.0 Request processed in 209us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779737.079453:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787779737.079537:0:3303:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.201.109@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1787779737.079545:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.109@tcp: connect to target with instance 0 00000100:00080000:3.0:1787779737.079552:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.109@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1787779737.079556:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1787779737.079560:0:3303:0:(import.c:65:import_set_state_nolock()) ffff98e743448800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1787779737.079568:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1787779737.079575:0:3303:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1787779737.079580:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87fdd1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:3303:1874622525040512:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1787779737.096782:0:14291:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787779737.097111:0:14291:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1787779737.097118:0:14291:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1787779737.097837:0:14291:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1787779737.097957:0:14291:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1787779737.098257:0:14291:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1787779737.098263:0:14291:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1787779737.099098:0:14291:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787779737.099284:0:14291:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1787779737.099289:0:14291:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1787779737.108044:0:14291:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1787779737.108058:0:14291:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1787779737.150431:0:14291:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787779737.150610:0:14291:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1787779737.150614:0:14291:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1787779737.153692:0:14291:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1787779737.153705:0:14291:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1787779737.154332:0:14291:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787779737.154513:0:14291:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787779737.154518:0:14291:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1787779737.155272:0:14291:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787779737.155281:0:14291:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1787779737.155967:0:14291:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787779737.156125:0:14291:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787779737.156131:0:14291:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1787779737.160485:0:14291:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787779737.160501:0:14291:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1787779737.164407:0:14291:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787779737.164613:0:14291:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787779737.164619:0:14291:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1787779737.165175:0:14291:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787779737.165182:0:14291:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1787779737.185333:0:14291:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787779737.185605:0:14291:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787779737.185618:0:14291:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1787779737.190094:0:14291:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787779737.190118:0:14291:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1787779737.190914:0:14291:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787779737.190923:0:14291:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1787779737.191698:0:14291:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1787779737.191749:0:14291:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1787779737.191756:0:14291:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.109@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1787779737.191883:0:14291:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.109@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787779737.191929:0:14291:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.109@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1787779737.191933:0:14291:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787779737.191935:0:14291:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787779737.191936:0:14291:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787779737.191938:0:14291:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787779737.191939:0:14291:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787779737.191941:0:14291:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787779737.191942:0:14291:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787779737.191944:0:14291:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787779737.191945:0:14291:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787779737.191947:0:14291:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787779737.191949:0:14291:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1787779737.191951:0:14291:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787779737.191953:0:14291:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787779737.191954:0:14291:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787779737.191955:0:14291:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787779737.191957:0:14291:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787779737.191958:0:14291:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787779737.191959:0:14291:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787779737.191960:0:14291:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787779737.191961:0:14291:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787779737.191963:0:14291:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787779737.191992:0:14291:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787779737.192012:0:14291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e852b9ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14291:1874622525040640:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787779737.192085:0:14291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779737.192137:0:14291:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e84721db40 going to sleep for 11 seconds 00000100:00100000:2.0:1787779737.192276:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525040640 00000100:00100000:2.0:1787779737.192283:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525040640 00000100:00100000:2.0:1787779737.192329:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787779737.192340:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e847629850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+5:14291:x1874622525040640:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787779737.192387:0:14304:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787779737.192390:0:14304:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787779737.192393:0:14304:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1787779737.193098:0:14325:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1787779737.193431:0:14304:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:1.0:1787779737.194402:0:14326:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1787779737.194408:0:14326:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1787779737.194410:0:14326:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1787779737.194444:0:14326:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:2.0:1787779737.195020:0:14304:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787779737.195031:0:14304:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1787779737.201303:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e847629850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+5:14291:x1874622525040640:12345-0@lo:253:mount.lustre.0 Request processed in 8953us (9207us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779737.201321:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787779737.201429:0:14291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e852b9ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14291:1874622525040640:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787779737.201448:0:14291:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787779737.201452:0:14291:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787779737.201454:0:14291:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787779737.201455:0:14291:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787779737.201457:0:14291:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787779737.201459:0:14291:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787779737.201460:0:14291:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787779737.201462:0:14291:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787779737.201464:0:14291:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787779737.201466:0:14291:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787779737.201467:0:14291:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787779737.201492:0:14291:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98e87f66b000 from lustre-MDT0000 10000000:01000000:1.0:1787779737.201523:0:14291:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1787779737.201527:0:14291:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787779737.201532:0:14291:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff98e87f03b370 10000000:01000000:1.0:1787779737.201538:0:14291:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787779737.201546:0:14291:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff98e87f03b370 from 1 10000000:01000000:1.0:1787779737.201549:0:14291:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787779737.201590:0:14291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e87a98b200/0x9e63ba8af6889f97 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779737.201601:0:14291:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff98e87a98b200/0x9e63ba8af6889f97 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779737.201611:0:14291:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff98e87a98b200/0x9e63ba8af6889f97 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779737.201630:0:14291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e852b9ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14291:1874622525040768:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787779737.201666:0:14291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779737.201773:0:14291:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e84721d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787779737.201923:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525040768 00000100:00100000:3.0:1787779737.201932:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525040768 00000100:00100000:3.0:1787779737.202008:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787779737.202017:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e847628050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+5:14291:x1874622525040768:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787779737.202031:0:14303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779737.202046:0:14303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e8429d4600/0x9e63ba8af6889f9e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9e63ba8af6889f97 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779737.202093:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e8429d4600/0x9e63ba8af6889f9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9e63ba8af6889f97 expref: 6 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779737.202103:0:14303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e8429d4600/0x9e63ba8af6889f9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af6889f97 expref: 6 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779737.202112:0:14303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e8429d4600, rc 0) 00000100:00100000:3.0:1787779737.202155:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e847628050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+6:14291:x1874622525040768:12345-0@lo:101:mount.lustre.0 Request processed in 139us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779737.202161:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787779737.202225:0:14291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e852b9ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14291:1874622525040768:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787779737.202239:0:14291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff98e87a98b200/0x9e63ba8af6889f97 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6889f9e expref: -99 pid: 14291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779737.202260:0:14291:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff98e87a98b200/0x9e63ba8af6889f97 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9e63ba8af6889f9e expref: -99 pid: 14291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779737.202308:0:14291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87fdd1e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14291:1874622525040896:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787779737.202336:0:14291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779737.202404:0:14291:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e87a716f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787779737.202472:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525040896 00000100:00100000:1.0:1787779737.202476:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525040896 00000100:00100000:1.0:1787779737.202502:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787779737.202508:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e84762bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+6:14291:x1874622525040896:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787779737.202772:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e84762bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+6:14291:x1874622525040896:12345-0@lo:501:mount.lustre.0 Request processed in 263us (434us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787779737.202780:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787779737.202874:0:14291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87fdd1e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14291:1874622525040896:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787779737.202913:0:14291:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787779737.202928:0:14291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e87a98b200/0x9e63ba8af6889f97 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6889f9e expref: -99 pid: 14291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779737.202937:0:14291:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff98e87a98b200/0x9e63ba8af6889f97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6889f9e expref: -99 pid: 14291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787779737.202945:0:14291:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98e87f66b000 10000000:01000000:0.0:1787779737.202950:0:14291:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787779737.202954:0:14291:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff98e87f66b000 10000000:01000000:0.0:1787779737.202957:0:14291:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1787779737.202960:0:14291:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff98e87f66b000 from 1 10000000:01000000:0.0:1787779737.202962:0:14291:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1787779737.202979:0:14291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e848f68600/0x9e63ba8af6889fa5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779737.202987:0:14291:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff98e848f68600/0x9e63ba8af6889fa5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779737.202994:0:14291:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff98e848f68600/0x9e63ba8af6889fa5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779737.203013:0:14291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87fdd1e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14291:1874622525041024:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787779737.203041:0:14291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779737.203071:0:14291:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e87a716f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787779737.203173:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525041024 00000100:00100000:1.0:1787779737.203177:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525041024 00000100:00100000:1.0:1787779737.203197:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787779737.203203:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e84762b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+6:14291:x1874622525041024:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787779737.203211:0:14301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779737.203223:0:14301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e87a98ac00/0x9e63ba8af6889fac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9e63ba8af6889fa5 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779737.203238:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e87a98ac00/0x9e63ba8af6889fac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9e63ba8af6889fa5 expref: 7 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779737.203247:0:14301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e87a98ac00/0x9e63ba8af6889fac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af6889fa5 expref: 7 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779737.203254:0:14301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87a98ac00, rc 0) 00000100:00100000:1.0:1787779737.203290:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e84762b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+7:14291:x1874622525041024:12345-0@lo:101:mount.lustre.0 Request processed in 86us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779737.203296:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787779737.203362:0:14291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87fdd1e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14291:1874622525041024:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787779737.203373:0:14291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff98e848f68600/0x9e63ba8af6889fa5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6889fac expref: -99 pid: 14291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779737.203381:0:14291:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff98e848f68600/0x9e63ba8af6889fa5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9e63ba8af6889fac expref: -99 pid: 14291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787779737.203392:0:14291:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1787779737.203395:0:14291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e848f68600/0x9e63ba8af6889fa5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6889fac expref: -99 pid: 14291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779737.203402:0:14291:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff98e848f68600/0x9e63ba8af6889fa5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6889fac expref: -99 pid: 14291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787779737.203409:0:14291:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787779737.203412:0:14291:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787779737.203416:0:14291:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff98e87f66b000 10000000:01000000:0.0:1787779737.203419:0:14291:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1787779737.203422:0:14291:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1787779737.203424:0:14291:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787779737.203437:0:14291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e848f68a00/0x9e63ba8af6889fb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779737.203445:0:14291:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff98e848f68a00/0x9e63ba8af6889fb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779737.203458:0:14291:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff98e848f68a00/0x9e63ba8af6889fb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779737.203470:0:14291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87fdd1e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14291:1874622525041152:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787779737.203494:0:14291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779737.203515:0:14291:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e87a716f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787779737.203557:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525041152 00000100:00100000:1.0:1787779737.203561:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525041152 00000100:00100000:1.0:1787779737.203578:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787779737.203584:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e84762a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+7:14291:x1874622525041152:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787779737.203591:0:14301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779737.203603:0:14301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e87a98b000/0x9e63ba8af6889fba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9e63ba8af6889fb3 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779737.203617:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e87a98b000/0x9e63ba8af6889fba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9e63ba8af6889fb3 expref: 8 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779737.203626:0:14301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e87a98b000/0x9e63ba8af6889fba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af6889fb3 expref: 8 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779737.203633:0:14301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87a98b000, rc 0) 00000100:00100000:1.0:1787779737.203667:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e84762a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+8:14291:x1874622525041152:12345-0@lo:101:mount.lustre.0 Request processed in 83us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779737.203674:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787779737.203747:0:14291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87fdd1e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14291:1874622525041152:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787779737.203757:0:14291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff98e848f68a00/0x9e63ba8af6889fb3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6889fba expref: -99 pid: 14291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779737.203766:0:14291:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff98e848f68a00/0x9e63ba8af6889fb3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9e63ba8af6889fba expref: -99 pid: 14291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779737.203803:0:14291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87fdd1e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14291:1874622525041280:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787779737.203827:0:14291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779737.203857:0:14291:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e87a716f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787779737.203975:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525041280 00000100:00100000:1.0:1787779737.203979:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525041280 00000100:00100000:1.0:1787779737.203997:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787779737.204002:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e847629c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+8:14291:x1874622525041280:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787779737.204454:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e847629c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+9:14291:x1874622525041280:12345-0@lo:501:mount.lustre.0 Request processed in 450us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779737.204462:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787779737.204651:0:14291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87fdd1e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14291:1874622525041280:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787779737.204685:0:14291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87fdd1e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14291:1874622525041408:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787779737.204830:0:14291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779737.204954:0:14291:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e87a716f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787779737.205199:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525041408 00000100:00100000:1.0:1787779737.205204:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525041408 00000100:00100000:1.0:1787779737.205275:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787779737.205283:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e847628450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+9:14291:x1874622525041408:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787779737.205607:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e847628450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+9:14291:x1874622525041408:12345-0@lo:503:mount.lustre.0 Request processed in 324us (776us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779737.205615:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787779737.205691:0:14291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87fdd1e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14291:1874622525041408:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787779737.206276:0:14327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87fdd1e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14327:1874622525041536:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787779737.206317:0:14327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779737.206457:0:14327:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e87a7163c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787779737.206530:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525041536 00000100:00100000:3.0:1787779737.206536:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525041536 00000100:00100000:3.0:1787779737.206562:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787779737.206570:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e847628850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+9:14327:x1874622525041536:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787779737.206837:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e847628850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+9:14327:x1874622525041536:12345-0@lo:502:llog_process_th.0 Request processed in 267us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779737.206854:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787779737.207002:0:14327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87fdd1e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14327:1874622525041536:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787779737.207024:0:14327:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787779737.207035:0:14327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787779737.207038:0:14327:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787779737.207044:0:14327:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1787779737.207047:0:14327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787779737.207062:0:14327:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff98e87f038000) 00000020:00000080:0.0:1787779737.207080:0:14327:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1787779737.207085:0:14327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1787779737.207149:0:14327:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:0.0:1787779737.207156:0:14327:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9e63ba8af6889fc8 00000020:00000080:0.0:1787779737.207364:0:14327:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1787779737.207369:0:14327:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787779737.207372:0:14327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787779737.207373:0:14327:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787779737.207376:0:14327:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787779737.207379:0:14327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787779737.207380:0:14327:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1787779737.207383:0:14327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787779737.207390:0:14327:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff98e87f0399b8) 00000020:00000080:0.0:1787779737.207398:0:14327:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1787779737.207402:0:14327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1787779737.207404:0:14327:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1787779737.207407:0:14327:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1787779737.207412:0:14327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787779737.207461:0:14327:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98e87f66b000 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1787779737.207475:0:14327:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff98e874594d28) 00000020:00000080:0.0:1787779737.207482:0:14327:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1787779737.207519:0:14327:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1787779737.207525:0:14327:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9e63ba8af6889fdd 00000020:00000080:0.0:1787779737.207614:0:14327:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1787779737.207620:0:14327:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1787779737.207631:0:14327:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x9e63ba8af6889fe4 00080000:01000000:0.0:1787779737.207637:0:14327:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:0.0:1787779737.207640:0:14327:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9e63ba8af6889feb 00010000:00010000:2.0:1787779737.260068:0:14327:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1787779737.260489:0:14327:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967527 00000001:00080000:2.0:1787779737.263180:0:14327:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787779737.263851:0:14327:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff98e844cb99b8) 00000020:00000080:2.0:1787779737.263873:0:14327:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1787779737.263944:0:14327:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787779737.263951:0:14327:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9e63ba8af6889ff9 00000020:00000080:2.0:1787779737.264594:0:14327:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1787779737.272400:0:14327:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x9e63ba8af688a000 00000020:00000080:2.0:1787779737.274028:0:14327:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1787779737.274044:0:14327:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787779737.274053:0:14327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787779737.274055:0:14327:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1787779737.274058:0:14327:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787779737.274061:0:14327:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1787779737.274063:0:14327:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787779737.274064:0:14327:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787779737.274066:0:14327:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787779737.274069:0:14327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787779737.274070:0:14327:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787779737.274073:0:14327:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787779737.274077:0:14327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787779737.274079:0:14327:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1787779737.274083:0:14327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1787779737.274125:0:14327:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1787779737.274145:0:14327:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787779737.274147:0:14327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787779737.274157:0:14327:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1787779737.274160:0:14327:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787779737.274164:0:14327:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1787779737.274167:0:14327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787779737.274168:0:14327:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1787779737.274171:0:14327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787779737.274176:0:14327:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.109@tcp to nid 0x20000c0a8c96d (192.168.201.109@tcp) 00000020:01000000:2.0:1787779737.274203:0:14327:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787779737.274206:0:14327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787779737.274221:0:14327:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff98e844cbcd28) 00000020:00000080:2.0:1787779737.274236:0:14327:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1787779737.274242:0:14327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787779737.274310:0:14327:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1787779737.274316:0:14327:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:2.0:1787779737.274322:0:14327:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9e63ba8af688a00e 00010000:00080000:2.0:1787779737.274356:0:14327:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98e85f572000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.109@tcp at head 00010000:00010000:2.0:1787779737.274558:0:14327:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:2.0:1787779737.276114:0:14327:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787779737.276170:0:14327:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787779737.278648:0:14327:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787779737.279944:0:14327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1787779737.280047:0:14327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1787779737.281687:0:14331:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787779737.281693:0:14331:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1787779737.283090:0:14327:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787779737.283102:0:14327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787779737.283133:0:14327:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1787779737.283153:0:14327:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9e63ba8af688a015 00000100:00080000:3.0:1787779737.283166:0:14327:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787779737.283172:0:14327:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff98e85f572000 using connection 192.168.201.109@tcp/0@lo 00000100:00100000:3.0:1787779737.283206:0:14327:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98e743504f00 x1874622525041664/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787779737.283237:0:14327:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1787779737.283284:0:14327:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787779737.283288:0:14327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787779737.283290:0:14327:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1787779737.283293:0:14327:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787779737.283296:0:14327:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:3.0:1787779737.283297:0:14327:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787779737.283299:0:14327:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787779737.283301:0:14327:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787779737.283303:0:14327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787779737.283304:0:14327:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787779737.283307:0:14327:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787779737.283311:0:14327:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1787779737.283315:0:14327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787779737.283316:0:14327:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1787779737.283318:0:14327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787779737.283322:0:14327:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.109@tcp to nid 0x20000c0a8c96d (192.168.201.109@tcp) 00000020:01000000:3.0:1787779737.283345:0:14327:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787779737.283348:0:14327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787779737.283360:0:14327:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff98e873b00000) 00000020:00000080:3.0:1787779737.283371:0:14327:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1787779737.283375:0:14327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787779737.283424:0:14327:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1787779737.283434:0:14327:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:3.0:1787779737.283447:0:14327:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9e63ba8af688a023 00010000:00080000:3.0:1787779737.283476:0:14327:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98e846b12800@lustre-OST0001-osc-MDT0000: add connection 192.168.201.109@tcp at head 00010000:00010000:3.0:1787779737.283666:0:14327:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000100:00100000:2.0:1787779737.283973:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e743504f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874622525041664:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1787779737.284025:0:3303:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874622525041664 offset 0 length 520: 4 00000100:00100000:2.0:1787779737.284119:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787779737.284126:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e741e6ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:3307:1874622525041792:0@lo:400:kworker.0 00000100:00100000:2.0:1787779737.284160:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779737.284190:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525041792 00000100:00100000:2.0:1787779737.284195:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525041792 00000100:00100000:2.0:1787779737.284229:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787779737.284245:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e847629450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+9:3307:x1874622525041792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779737.284292:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e847629450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+9:3307:x1874622525041792:12345-0@lo:400:kworker.0 Request processed in 48us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779737.284299:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787779737.284339:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e741e6ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:3307:1874622525041792:0@lo:400:kworker.0 00000040:01000000:3.0:1787779737.284429:0:14327:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787779737.284452:0:14327:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787779737.285292:0:14327:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787779737.285357:0:14327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1787779737.285423:0:14327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1787779737.286045:0:14333:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787779737.286050:0:14333:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1787779737.287163:0:14327:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787779737.287177:0:14327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787779737.287212:0:14327:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787779737.287232:0:14327:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9e63ba8af688a02a 00000100:00080000:3.0:1787779737.287243:0:14327:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787779737.287249:0:14327:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98e846b12800 using connection 192.168.201.109@tcp/0@lo 00000100:00100000:3.0:1787779737.287285:0:14327:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98e743505680 x1874622525041920/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787779737.287339:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e743505680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874622525041920:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1787779737.287414:0:3303:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874622525041920 offset 0 length 520: 4 00000100:00080000:3.0:1787779737.287467:0:14327:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1787779737.287522:0:14327:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787779737.287526:0:14327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787779737.287528:0:14327:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1787779737.287531:0:14327:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787779737.287535:0:14327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787779737.287536:0:14327:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787779737.287539:0:14327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787779737.287541:0:14327:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787779737.287543:0:14327:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787779737.287545:0:14327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787779737.287547:0:14327:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787779737.287549:0:14327:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787779737.287551:0:14327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787779737.287552:0:14327:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787779737.287556:0:14327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787779737.287594:0:14327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e7435052c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14327:1874622525042048:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787779737.287639:0:14327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779737.287658:0:14327:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e8505bbb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787779737.287837:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525042048 00000100:00100000:3.0:1787779737.287917:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525042048 00000100:00100000:3.0:1787779737.287967:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787779737.287977:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e847628c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+9:14327:x1874622525042048:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787779737.288260:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e847628c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+9:14327:x1874622525042048:12345-0@lo:502:llog_process_th.0 Request processed in 284us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779737.288269:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787779737.288507:0:14327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e7435052c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14327:1874622525042048:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787779737.288541:0:14327:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787779737.288546:0:14327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787779737.288548:0:14327:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787779737.288552:0:14327:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1787779737.289264:0:14291:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:2.0:1787779737.289289:0:14291:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787779737.289349:0:14291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e848f68a00/0x9e63ba8af6889fb3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6889fba expref: -99 pid: 14291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779737.289360:0:14291:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff98e848f68a00/0x9e63ba8af6889fb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6889fba expref: -99 pid: 14291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787779737.289368:0:14291:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98e87f66b000 from 1 10000000:01000000:2.0:1787779737.289371:0:14291:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787779737.289403:0:14291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e87aa66a00/0x9e63ba8af688a031 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779737.289411:0:14291:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff98e87aa66a00/0x9e63ba8af688a031 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779737.289420:0:14291:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff98e87aa66a00/0x9e63ba8af688a031 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779737.289446:0:14291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e741e6ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14291:1874622525042176:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787779737.289490:0:14291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779737.289528:0:14291:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e8495abc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787779737.289579:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525042176 00000100:00100000:1.0:1787779737.289584:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525042176 00000100:00100000:1.0:1787779737.289621:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787779737.289628:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e84762a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+9:14291:x1874622525042176:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787779737.289639:0:14301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779737.289653:0:14301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e87a98a800/0x9e63ba8af688a038 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9e63ba8af688a031 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779737.289673:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e87a98a800/0x9e63ba8af688a038 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9e63ba8af688a031 expref: 10 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779737.289683:0:14301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e87a98a800/0x9e63ba8af688a038 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af688a031 expref: 10 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779737.289691:0:14301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87a98a800, rc 0) 00000100:00100000:1.0:1787779737.289835:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e84762a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+10:14291:x1874622525042176:12345-0@lo:101:mount.lustre.0 Request processed in 207us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779737.289912:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787779737.289981:0:14291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e741e6ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14291:1874622525042176:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787779737.289994:0:14291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff98e87aa66a00/0x9e63ba8af688a031 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af688a038 expref: -99 pid: 14291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779737.290003:0:14291:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff98e87aa66a00/0x9e63ba8af688a031 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9e63ba8af688a038 expref: -99 pid: 14291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779737.290522:0:14291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e741e6ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14291:1874622525042304:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1787779737.290559:0:14291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779737.290637:0:14291:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e8495abc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787779737.290834:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525042304 00000100:00100000:0.0:1787779737.290839:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525042304 00000100:00100000:0.0:1787779737.290975:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787779737.290983:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e84762b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+10:14291:x1874622525042304:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1787779737.291001:0:14303:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1787779737.291006:0:14303:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1787779737.291099:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e84762b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+10:14291:x1874622525042304:12345-0@lo:256:mount.lustre.0 Request processed in 117us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779737.291105:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787779737.291170:0:14291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e741e6ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14291:1874622525042304:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1787779737.291834:0:14291:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787779737.291862:0:14291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e87aa66a00/0x9e63ba8af688a031 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af688a038 expref: -99 pid: 14291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779737.291873:0:14291:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff98e87aa66a00/0x9e63ba8af688a031 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af688a038 expref: -99 pid: 14291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787779737.291880:0:14291:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98e87f66b000 from 1 10000000:01000000:3.0:1787779737.291883:0:14291:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787779737.291923:0:14291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e8429d4400/0x9e63ba8af688a03f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779737.291931:0:14291:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff98e8429d4400/0x9e63ba8af688a03f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779737.291940:0:14291:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff98e8429d4400/0x9e63ba8af688a03f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779737.291968:0:14291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e743506940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14291:1874622525042432:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787779737.292004:0:14291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779737.292299:0:14291:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e846b0b000 going to sleep for 11 seconds 00000100:00100000:2.0:1787779737.292378:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525042432 00000100:00100000:2.0:1787779737.292384:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525042432 00000100:00100000:2.0:1787779737.292413:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787779737.292421:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e84762b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+10:14291:x1874622525042432:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787779737.292432:0:14304:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779737.292446:0:14304:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e87aa66800/0x9e63ba8af688a046 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9e63ba8af688a03f expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779737.292464:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e87aa66800/0x9e63ba8af688a046 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9e63ba8af688a03f expref: 11 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779737.292475:0:14304:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e87aa66800/0x9e63ba8af688a046 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af688a03f expref: 11 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779737.292495:0:14304:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87aa66800, rc 0) 00000100:00100000:2.0:1787779737.292536:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e84762b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+11:14291:x1874622525042432:12345-0@lo:101:mount.lustre.0 Request processed in 114us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779737.292542:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787779737.292642:0:14291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e743506940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14291:1874622525042432:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787779737.292654:0:14291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff98e8429d4400/0x9e63ba8af688a03f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af688a046 expref: -99 pid: 14291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779737.292664:0:14291:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff98e8429d4400/0x9e63ba8af688a03f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9e63ba8af688a046 expref: -99 pid: 14291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779737.292769:0:14291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e743506940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14291:1874622525042560:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787779737.292795:0:14291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779737.292862:0:14291:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e846b0b000 going to sleep for 11 seconds 00000100:00100000:0.0:1787779737.292967:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525042560 00000100:00100000:0.0:1787779737.292972:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525042560 00000100:00100000:1.0:1787779737.293051:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787779737.293061:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e847629050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+11:14291:x1874622525042560:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787779737.293496:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e847629050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+11:14291:x1874622525042560:12345-0@lo:501:mount.lustre.0 Request processed in 436us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779737.293504:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787779737.293606:0:14291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e743506940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14291:1874622525042560:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787779737.293636:0:14291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e743506940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14291:1874622525042688:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787779737.293672:0:14291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779737.293695:0:14291:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e846b0b000 going to sleep for 11 seconds 00000100:00100000:2.0:1787779737.293747:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525042688 00000100:00100000:2.0:1787779737.293751:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525042688 00000100:00100000:2.0:1787779737.293770:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787779737.293776:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e85f557850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+11:14291:x1874622525042688:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787779737.293975:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e85f557850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+11:14291:x1874622525042688:12345-0@lo:503:mount.lustre.0 Request processed in 198us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779737.293983:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787779737.294186:0:14291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e743506940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14291:1874622525042688:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787779737.294647:0:14335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e741e6e580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14335:1874622525042816:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787779737.294688:0:14335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779737.294817:0:14335:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e8518d4600 going to sleep for 11 seconds 00000100:00100000:0.0:1787779737.294939:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525042816 00000100:00100000:0.0:1787779737.294943:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525042816 00000100:00100000:0.0:1787779737.295011:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787779737.295019:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e85f555450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+11:14335:x1874622525042816:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787779737.295238:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e85f555450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+11:14335:x1874622525042816:12345-0@lo:502:llog_process_th.0 Request processed in 219us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779737.295246:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787779737.295317:0:14335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e741e6e580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14335:1874622525042816:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787779737.295340:0:14335:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787779737.295351:0:14335:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787779737.295353:0:14335:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787779737.295362:0:14335:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98e87f66b000 00000020:00000080:3.0:1787779737.295365:0:14335:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787779737.295381:0:14335:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787779737.295384:0:14335:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787779737.295385:0:14335:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787779737.295388:0:14335:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787779737.295391:0:14335:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787779737.295392:0:14335:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787779737.295396:0:14335:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98e87f66b000 00000020:00000080:3.0:1787779737.295398:0:14335:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787779737.295450:0:14335:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787779737.295453:0:14335:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787779737.295455:0:14335:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787779737.295457:0:14335:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787779737.295460:0:14335:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787779737.295461:0:14335:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787779737.295464:0:14335:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98e87f66b000 00000020:00000080:3.0:1787779737.295467:0:14335:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787779737.295506:0:14335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e743506940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14335:1874622525042944:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787779737.295542:0:14335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779737.295679:0:14335:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e846b0b000 going to sleep for 11 seconds 00000100:00100000:2.0:1787779737.295817:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525042944 00000100:00100000:2.0:1787779737.295822:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525042944 00000100:00100000:2.0:1787779737.295855:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787779737.295862:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e85f555050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+11:14335:x1874622525042944:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787779737.296019:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e85f555050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+11:14335:x1874622525042944:12345-0@lo:502:llog_process_th.0 Request processed in 157us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779737.296026:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787779737.299293:0:14335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e743506940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14335:1874622525042944:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787779737.299346:0:14335:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787779737.299356:0:14335:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787779737.299359:0:14335:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787779737.299365:0:14335:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1787779737.299447:0:14291:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1787779737.299465:0:14291:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787779737.299482:0:14291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e8429d4400/0x9e63ba8af688a03f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af688a046 expref: -99 pid: 14291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779737.299495:0:14291:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff98e8429d4400/0x9e63ba8af688a03f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af688a046 expref: -99 pid: 14291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787779737.299551:0:14291:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787779737.299554:0:14291:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98e87f66b000 10000000:01000000:3.0:1787779737.299557:0:14291:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98e87f66b000 10000000:01000000:3.0:1787779737.299560:0:14291:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787779737.299566:0:14291:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98e87f66b000 from 1 10000000:01000000:3.0:1787779737.299569:0:14291:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787779737.299601:0:14291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e8429d5c00/0x9e63ba8af688a04d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779737.299610:0:14291:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff98e8429d5c00/0x9e63ba8af688a04d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779737.299619:0:14291:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff98e8429d5c00/0x9e63ba8af688a04d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779737.299639:0:14291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e743506940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14291:1874622525043072:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787779737.299707:0:14291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779737.299779:0:14291:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e846b0b780 going to sleep for 11 seconds 00000100:00100000:0.0:1787779737.299972:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525043072 00000100:00100000:0.0:1787779737.299979:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525043072 00000100:00100000:0.0:1787779737.300023:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787779737.300033:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e85f556450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+11:14291:x1874622525043072:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787779737.300047:0:14303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787779737.300071:0:14303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e848f68200/0x9e63ba8af688a054 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9e63ba8af688a04d expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779737.300095:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e848f68200/0x9e63ba8af688a054 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9e63ba8af688a04d expref: 12 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779737.300106:0:14303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e848f68200/0x9e63ba8af688a054 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af688a04d expref: 12 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779737.300113:0:14303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e848f68200, rc 0) 00000100:00100000:0.0:1787779737.300171:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e85f556450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+12:14291:x1874622525043072:12345-0@lo:101:mount.lustre.0 Request processed in 138us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779737.300179:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787779737.300269:0:14291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e743506940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14291:1874622525043072:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787779737.300282:0:14291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff98e8429d5c00/0x9e63ba8af688a04d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af688a054 expref: -99 pid: 14291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779737.300292:0:14291:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff98e8429d5c00/0x9e63ba8af688a04d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9e63ba8af688a054 expref: -99 pid: 14291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779737.300333:0:14291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e743506940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14291:1874622525043200:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787779737.300358:0:14291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779737.300389:0:14291:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e846b0b780 going to sleep for 11 seconds 00000100:00100000:0.0:1787779737.300444:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525043200 00000100:00100000:0.0:1787779737.300448:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525043200 00000100:00100000:0.0:1787779737.300464:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787779737.300470:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e85f554850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+12:14291:x1874622525043200:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787779737.300736:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e85f554850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+12:14291:x1874622525043200:12345-0@lo:501:mount.lustre.0 Request processed in 240us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779737.300743:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787779737.300826:0:14291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e743506940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14291:1874622525043200:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787779737.300861:0:14291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e743506940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14291:1874622525043328:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787779737.300907:0:14291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779737.300924:0:14291:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e846b0b780 going to sleep for 11 seconds 00000100:00100000:0.0:1787779737.301031:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525043328 00000100:00100000:0.0:1787779737.301035:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525043328 00000100:00100000:0.0:1787779737.301053:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787779737.301059:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e85f554050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+12:14291:x1874622525043328:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787779737.301206:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e85f554050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+12:14291:x1874622525043328:12345-0@lo:503:mount.lustre.0 Request processed in 147us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779737.301213:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787779737.303125:0:14291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e743506940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14291:1874622525043328:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787779737.303489:0:14337:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e743506940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14337:1874622525043456:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787779737.303548:0:14337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779737.303589:0:14337:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e846b0be40 going to sleep for 11 seconds 00000100:00100000:1.0:1787779737.303635:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525043456 00000100:00100000:1.0:1787779737.303646:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525043456 00000100:00100000:1.0:1787779737.303687:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787779737.303695:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e85f556c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+12:14337:x1874622525043456:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787779737.304000:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e85f556c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+12:14337:x1874622525043456:12345-0@lo:502:llog_process_th.0 Request processed in 305us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779737.304008:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787779737.304964:0:14337:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e743506940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14337:1874622525043456:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1787779737.305027:0:14337:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1787779737.305043:0:14337:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff98e873b03370) 00000020:00000080:3.0:1787779737.305064:0:14337:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:3.0:1787779737.305145:0:14337:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98e87f66b000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787779737.305149:0:14337:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98e87f66b000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787779737.305152:0:14337:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98e87f66b000 4 00010000:00080000:3.0:1787779737.305190:0:14337:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98e844cf8000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.109@tcp at head 00010000:00010000:3.0:1787779737.309306:0:14337:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:3.0:1787779737.309533:0:14337:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1787779737.309570:0:14337:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787779737.309584:0:14337:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x9e63ba8af688a062 00000100:00080000:3.0:1787779737.309596:0:14337:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787779737.309603:0:14337:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff98e844cf8000 using connection 192.168.201.109@tcp/0@lo 00000100:00100000:3.0:1787779737.309649:0:14337:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98e743506940 x1874622525043584/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787779737.309700:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e743506940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874622525043584:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787779737.309818:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779737.309973:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525043584 00000100:00100000:2.0:1787779737.309983:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525043584 00000100:00100000:2.0:1787779737.310021:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787779737.310030:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e7435052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1874622525043584:12345-0@lo:38:llog_process_th.0 00000100:00080000:3.0:1787779737.310130:0:14337:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787779737.310394:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e7435052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1874622525043584:12345-0@lo:38:llog_process_th.0 Request processed in 363us (576us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787779737.310403:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787779737.310527:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787779737.310536:0:3303:0:(import.c:65:import_set_state_nolock()) ffff98e844cf8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787779737.310541:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787779737.310545:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e743506940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874622525043584:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787779737.311024:0:14337:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e743506940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14337:1874622525043712:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787779737.311084:0:14337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779737.311112:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525043712 00000100:00100000:3.0:1787779737.311117:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525043712 00000100:00100000:3.0:1787779737.311155:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787779737.311162:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e85f556050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+12:14337:x1874622525043712:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787779737.311412:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e85f556050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+12:14337:x1874622525043712:12345-0@lo:502:llog_process_th.0 Request processed in 249us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779737.311419:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787779737.311461:0:14337:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e846b0bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787779737.311475:0:14337:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e743506940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14337:1874622525043712:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787779737.311496:0:14337:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1787779737.311596:0:14291:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1787779737.311623:0:14291:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787779737.311646:0:14291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e8429d5c00/0x9e63ba8af688a04d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af688a054 expref: -99 pid: 14291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779737.311657:0:14291:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff98e8429d5c00/0x9e63ba8af688a04d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af688a054 expref: -99 pid: 14291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787779737.313095:0:14291:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787779737.313099:0:14291:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787779737.313100:0:14291:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787779737.313102:0:14291:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787779737.313103:0:14291:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787779737.313105:0:14291:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787779737.313107:0:14291:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787779737.313108:0:14291:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787779737.313110:0:14291:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787779737.313111:0:14291:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787779737.313115:0:14291:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1787779737.313118:0:14291:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787779737.313119:0:14291:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787779737.313120:0:14291:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787779737.313121:0:14291:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787779737.313122:0:14291:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787779737.313581:0:14291:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787779737.313584:0:14291:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787779737.313585:0:14291:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787779737.313586:0:14291:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787779737.313593:0:14291:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787779737.313618:0:14291:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787779737.313638:0:14291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e852b9cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14291:1874622525043840:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787779737.313700:0:14291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779737.313752:0:14291:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e8450ffd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787779737.313773:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525043840 00000100:00100000:1.0:1787779737.313779:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525043840 00000100:00100000:1.0:1787779737.321037:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787779737.321058:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e85f557450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+12:14291:x1874622525043840:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787779737.321098:0:14304:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787779737.321110:0:14304:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787779737.376210:0:14304:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787779737.376255:0:14304:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1787779737.376590:0:14325:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787779737.376609:0:14325:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787779737.376631:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98e848f69400/0x9e63ba8af688a069 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779737.376651:0:14325:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98e87a98a800/0x9e63ba8af688a038 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af688a031 expref: 12 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779737.376660:0:14325:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98e848f69400/0x9e63ba8af688a069 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779737.376700:0:14325:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98e87a98a800/0x9e63ba8af688a038 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9e63ba8af688a031 expref: 12 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779737.376743:0:14325:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98e87a98a800/0x9e63ba8af688a038 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9e63ba8af688a031 expref: 12 pid: 14301 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779737.376757:0:14325:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87fdd1e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14325:1874622525043968:0@lo:104: 00000100:00100000:0.0:1787779737.376827:0:14325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779737.376958:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525043968 00000100:00100000:1.0:1787779737.376966:0:14292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525043968 00000100:00100000:1.0:1787779737.377020:0:14292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787779737.377029:0:14292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87fdd2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+3:14325:x1874622525043968:12345-0@lo:104: 00010000:00010000:1.0:1787779737.377042:0:14292:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.109@tcp lock: ffff98e87aa66a00/0x9e63ba8af688a031 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9e63ba8af688a038 expref: -99 pid: 14291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779737.377152:0:14325:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e845f4fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1787779737.377380:0:14325:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87fdd1e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14325:1874622525043968:0@lo:104: 00010000:00010000:2.0:1787779737.377399:0:14325:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98e848f69400/0x9e63ba8af688a069 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779737.377430:0:14292:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787779737.377438:0:14292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87fdd2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+3:14325:x1874622525043968:12345-0@lo:104: Request processed in 410us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779737.377446:0:14292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1787779737.378100:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787779737.378109:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff98e87aa66a00/0x9e63ba8af688a031 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9e63ba8af688a038 expref: -99 pid: 14291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779737.378118:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87aa66a00 already unused, calling callback (ffffffffc1cd5c20) 10000000:00010000:3.0:1787779737.378122:0:14298:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff98e87aa66a00/0x9e63ba8af688a031 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9e63ba8af688a038 expref: -99 pid: 14291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779737.378145:0:14298:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff98e87aa66a00/0x9e63ba8af688a031 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9e63ba8af688a038 expref: -99 pid: 14291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787779737.378152:0:14298:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff98e87aa66a00/0x9e63ba8af688a031 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9e63ba8af688a038 expref: -99 pid: 14291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787779737.378158:0:14298:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787779737.378200:0:14298:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.109@tcp lock: ffff98e87aa66a00/0x9e63ba8af688a031 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af688a038 expref: -99 pid: 14291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779737.378207:0:14298:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787779737.378225:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff98e87aa66a00/0x9e63ba8af688a031 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af688a038 expref: -99 pid: 14291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779737.378233:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff98e87aa66a00/0x9e63ba8af688a031 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af688a038 expref: -99 pid: 14291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779737.378249:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787779737.378253:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787779737.378254:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779737.378302:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787779737.378317:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e743506940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:3306:1874622525044096:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787779737.378356:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779737.378460:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525044096 00000100:00100000:3.0:1787779737.378466:0:14294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525044096 00010000:00010000:3.0:1787779737.378488:0:14294:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98e87a98a800/0x9e63ba8af688a038 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9e63ba8af688a031 expref: 13 pid: 14301 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779737.378523:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787779737.378531:0:14294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e852b9da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+13:3306:x1874622525044096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787779737.378542:0:14294:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787779737.378547:0:14294:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98e87a98a800/0x9e63ba8af688a038 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9e63ba8af688a031 expref: 13 pid: 14301 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779737.378565:0:14294:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98e87a98a800/0x9e63ba8af688a038 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9e63ba8af688a031 expref: 13 pid: 14301 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779737.378579:0:14294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e87a98a800/0x9e63ba8af688a038 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9e63ba8af688a031 expref: 13 pid: 14301 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779737.378593:0:14294:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98e848f69400/0x9e63ba8af688a069 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779737.378602:0:14294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e848f69400/0x9e63ba8af688a069 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787779737.378616:0:14294:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002007870s 00010000:00010000:3.0:1787779737.378620:0:14294:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98e848f69400/0x9e63ba8af688a069 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779737.378628:0:14294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98e848f69400/0x9e63ba8af688a069 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779737.378635:0:14294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98e848f69400/0x9e63ba8af688a069 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779737.378642:0:14294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98e848f69400/0x9e63ba8af688a069 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779737.378647:0:14294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e848f69400 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:3.0:1787779737.378652:0:14294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98e848f69400/0x9e63ba8af688a069 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779737.378660:0:14294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98e848f69400/0x9e63ba8af688a069 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779737.378682:0:14294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98e848f69400/0x9e63ba8af688a069 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779737.378692:0:14294:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787779737.378749:0:14294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e852b9da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+12:3306:x1874622525044096:12345-0@lo:103:ldlm_bl.0 Request processed in 219us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779737.378757:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787779737.378836:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e743506940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:3306:1874622525044096:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787779737.379441:0:14325:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98e848f69400/0x9e63ba8af688a069 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779737.379452:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98e848f69400/0x9e63ba8af688a069 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779737.379459:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e848f69400/0x9e63ba8af688a069 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779737.386192:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e85f557450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+11:14291:x1874622525043840:12345-0@lo:253:mount.lustre.0 Request processed in 65134us (72484us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779737.386208:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787779737.386294:0:14291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e852b9cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14291:1874622525043840:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787779737.386311:0:14291:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787779737.386322:0:14291:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787779737.386324:0:14291:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787779737.386325:0:14291:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787779737.386327:0:14291:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787779737.386328:0:14291:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787779737.386329:0:14291:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787779737.386331:0:14291:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787779737.386332:0:14291:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787779737.386334:0:14291:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787779737.386335:0:14291:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787779737.386355:0:14291:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787779737.391707:0:14291:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1787779737.392335:0:14291:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787779737.392620:0:14291:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1787779737.392995:0:14291:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787779737.393271:0:14291:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1787779737.393422:0:14291:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1787779737.394648:0:14291:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1787779737.395810:0:14291:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1787779737.396408:0:14291:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1787779737.396675:0:14291:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1787779737.397390:0:14291:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1787779737.397572:0:14291:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:1.0:1787779737.429207:0:14291:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1787779737.429478:0:14291:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1787779737.429990:0:14348:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:1.0:1787779737.430244:0:14348:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:0.0:1787779737.437371:0:14347:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1787779737.437382:0:14347:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:1.0:1787779737.438272:0:14348:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787779737.438370:0:14348:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1787779737.438375:0:14348:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:2.0:1787779737.441598:0:14291:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1787779737.441780:0:14291:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1787779737.442504:0:14291:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1787779737.442571:0:14291:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1787779737.442987:0:14291:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787779737.446008:0:14291:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1787779737.446936:0:14291:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1787779737.446984:0:14291:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:2.0:1787779737.449242:0:14291:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:2.0:1787779737.458767:0:14291:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1787779737.502836:0:14291:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1787779737.502908:0:14291:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbf1d81cf3988 00100000:10000000:2.0:1787779737.502917:0:14291:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1787779737.504287:0:14291:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787779737.504305:0:14291:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.109@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787779737.504320:0:14291:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1787779737.504338:0:14291:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1787779738.110741:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787779738.355397:0:14343:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:0.0:1787779739.122788:0:14306:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787779739.122797:0:14306:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98e87f66b000 from 6 10000000:01000000:0.0:1787779739.122803:0:14306:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787779739.122858:0:14306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e848f68c00/0x9e63ba8af688a070 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779739.122884:0:14306:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff98e848f68c00/0x9e63ba8af688a070 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779739.122903:0:14306:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff98e848f68c00/0x9e63ba8af688a070 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779739.122930:0:14306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87fdd3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14306:1874622525044224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787779739.123009:0:14306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779739.123182:0:14306:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e845f4ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1787779739.123300:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525044224 00000100:00100000:3.0:1787779739.123307:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525044224 00000100:00100000:3.0:1787779739.123356:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787779739.123365:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e85f555c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+11:14306:x1874622525044224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787779739.123379:0:14301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779739.123394:0:14301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e8429d5a00/0x9e63ba8af688a077 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9e63ba8af688a070 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779739.123417:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e8429d5a00/0x9e63ba8af688a077 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9e63ba8af688a070 expref: 12 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779739.123429:0:14301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e8429d5a00/0x9e63ba8af688a077 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af688a070 expref: 12 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779739.123438:0:14301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e8429d5a00, rc 0) 00000100:00100000:3.0:1787779739.123916:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e85f555c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+12:14306:x1874622525044224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 551us (906us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779739.123924:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1787779739.124118:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779739.125962:0:14306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87fdd3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14306:1874622525044224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787779739.125995:0:14306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff98e848f68c00/0x9e63ba8af688a070 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af688a077 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779739.126008:0:14306:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff98e848f68c00/0x9e63ba8af688a070 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9e63ba8af688a077 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779739.126358:0:14306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e852b9e940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14306:1874622525044352:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787779739.126417:0:14306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779739.126468:0:14306:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e848e73000 going to sleep for 11 seconds 00000100:00100000:2.0:1787779739.126539:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525044352 00000100:00100000:2.0:1787779739.126544:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525044352 00000100:00100000:2.0:1787779739.126581:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787779739.126588:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e85f554c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+12:14306:x1874622525044352:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787779739.126605:0:14304:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787779739.126618:0:14304:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787779739.126620:0:14304:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1787779739.126703:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e85f554c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+12:14306:x1874622525044352:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 114us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779739.126733:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787779739.126944:0:14306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e852b9e940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14306:1874622525044352:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787779739.127008:0:14306:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787779739.127016:0:14306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e848f68c00/0x9e63ba8af688a070 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af688a077 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779739.127026:0:14306:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff98e848f68c00/0x9e63ba8af688a070 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af688a077 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787779739.380403:0:14343:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787779740.147156:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779741.170969:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787779742.196129:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787779742.450380:0:14591:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg109-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:1.0:1787779742.653905:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787779742.653912:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787779742.653915:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787779742.653918:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787779742.653921:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787779742.653924:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787779742.653928:0:38:0:(import.c:65:import_set_state_nolock()) ffff98e844cf8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787779742.653939:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff98e844cf8000 using connection 192.168.201.109@tcp/0@lo 00000100:00100000:1.0:1787779742.653963:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98e852b9cf00 x1874622525044608/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787779742.656485:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787779742.656514:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e852b9e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:3305:1874622525044480:0@lo:400:kworker.0 00000100:00100000:2.0:1787779742.656912:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e852b9cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874622525044608:0@lo:38:kworker.0 00000100:00100000:2.0:1787779742.662609:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779742.662676:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525044608 00000100:00100000:2.0:1787779742.662685:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525044608 00000100:00100000:2.0:1787779742.662739:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787779742.662747:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e741e6de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3303:x1874622525044608:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1787779742.662781:0:14311:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 508 last 0 00000020:00000080:2.0:1787779742.662835:0:14311:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x9e63ba8af688a07e 00000004:00100000:2.0:1787779742.662851:0:14311:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787779742.663000:0:14311:0:(import.c:65:import_set_state_nolock()) ffff98e87402d000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787779742.663054:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e741e6de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874622525044608:12345-0@lo:38:kworker.0 Request processed in 307us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779742.663073:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787779742.663156:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98e852b9cf00 x1874622525044608/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787779752 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787779742.663174:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1787779742.663181:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1787779742.663187:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787779742.663190:0:3303:0:(import.c:65:import_set_state_nolock()) ffff98e844cf8000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787779742.663202:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e852b9cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874622525044608:0@lo:38:kworker.0 00000100:00100000:3.0:1787779742.666675:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779742.666850:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525044480 00000100:00100000:3.0:1787779742.666859:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525044480 00000100:00100000:3.0:1787779742.666907:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787779742.666916:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e85f555850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+12:3305:x1874622525044480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779742.666981:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e85f555850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+12:3305:x1874622525044480:12345-0@lo:400:kworker.0 Request processed in 66us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779742.666988:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787779742.667035:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e852b9e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:3305:1874622525044480:0@lo:400:kworker.0 00010000:00010000:0.0:1787779743.229283:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779744.246000:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787779745.267408:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787779745.771364:0:14741:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe7560f5f0 20000000:00000080:1.0:1787779745.771380:0:14741:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98e85f58c800 uarg=0000000000000000 20000000:01000000:1.0:1787779745.771411:0:14741:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1787779745.771417:0:14741:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1787779745.771422:0:14741:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1787779745.772541:0:14742:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:1.0:1787779745.772869:0:14741:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787779745.787137:0:14741:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787779745.787168:0:14741:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98e87a98aa00/0x9e63ba8af688a085 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779745.787187:0:14741:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98e87aa66800/0x9e63ba8af688a046 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af688a03f expref: 11 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779745.787196:0:14741:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98e87a98aa00/0x9e63ba8af688a085 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779745.787245:0:14741:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98e87aa66800/0x9e63ba8af688a046 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9e63ba8af688a03f expref: 11 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779745.787260:0:14741:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98e87aa66800/0x9e63ba8af688a046 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9e63ba8af688a03f expref: 11 pid: 14304 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779745.787275:0:14741:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e852b9f840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14741:1874622525044736:0@lo:104: 00000100:00100000:1.0:1787779745.787341:0:14741:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779745.787402:0:14741:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e848e73780 going to sleep for 11 seconds 00000100:00100000:0.0:1787779745.787560:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525044736 00000100:00100000:0.0:1787779745.787567:0:14292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525044736 00000100:00100000:0.0:1787779745.787625:0:14292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787779745.787634:0:14292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e852b9fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+3:14741:x1874622525044736:12345-0@lo:104: 00010000:00010000:0.0:1787779745.787646:0:14292:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.109@tcp lock: ffff98e8429d4400/0x9e63ba8af688a03f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9e63ba8af688a046 expref: -99 pid: 14291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779745.787757:0:14292:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787779745.787763:0:14292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e852b9fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+3:14741:x1874622525044736:12345-0@lo:104: Request processed in 131us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779745.787770:0:14292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1787779745.787909:0:14297:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787779745.787917:0:14297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff98e8429d4400/0x9e63ba8af688a03f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9e63ba8af688a046 expref: -99 pid: 14291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779745.787925:0:14297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e8429d4400 already unused, calling callback (ffffffffc1cd5c20) 10000000:00010000:2.0:1787779745.787929:0:14297:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff98e8429d4400/0x9e63ba8af688a03f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9e63ba8af688a046 expref: -99 pid: 14291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779745.787938:0:14297:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff98e8429d4400/0x9e63ba8af688a03f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9e63ba8af688a046 expref: -99 pid: 14291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787779745.787945:0:14297:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff98e8429d4400/0x9e63ba8af688a03f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9e63ba8af688a046 expref: -99 pid: 14291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787779745.787951:0:14297:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787779745.787997:0:14297:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.109@tcp lock: ffff98e8429d4400/0x9e63ba8af688a03f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af688a046 expref: -99 pid: 14291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779745.788004:0:14297:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787779745.788037:0:14297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff98e8429d4400/0x9e63ba8af688a03f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af688a046 expref: -99 pid: 14291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779745.788045:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff98e8429d4400/0x9e63ba8af688a03f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af688a046 expref: -99 pid: 14291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779745.788066:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779745.788068:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779745.788070:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787779745.788078:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787779745.788088:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e741e6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:3304:1874622525044864:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787779745.788122:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779745.790907:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525044864 00000100:00100000:3.0:1787779745.790936:0:14294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525044864 00010000:00010000:3.0:1787779745.790986:0:14294:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98e87aa66800/0x9e63ba8af688a046 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9e63ba8af688a03f expref: 12 pid: 14304 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779745.791024:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787779745.791032:0:14294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e741e6c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+12:3304:x1874622525044864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787779745.791049:0:14294:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787779745.791054:0:14294:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98e87aa66800/0x9e63ba8af688a046 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9e63ba8af688a03f expref: 12 pid: 14304 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779745.791085:0:14294:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98e87aa66800/0x9e63ba8af688a046 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9e63ba8af688a03f expref: 12 pid: 14304 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779745.791109:0:14294:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98e87a98aa00/0x9e63ba8af688a085 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779745.791117:0:14294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e87a98aa00/0x9e63ba8af688a085 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779745.791135:0:14294:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98e87a98aa00/0x9e63ba8af688a085 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779745.791142:0:14294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98e87a98aa00/0x9e63ba8af688a085 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779745.791148:0:14294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98e87a98aa00/0x9e63ba8af688a085 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779745.791154:0:14294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98e87a98aa00/0x9e63ba8af688a085 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779745.791160:0:14294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87a98aa00 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:3.0:1787779745.791164:0:14294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98e87a98aa00/0x9e63ba8af688a085 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779745.791172:0:14294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98e87a98aa00/0x9e63ba8af688a085 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779745.791182:0:14294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98e87a98aa00/0x9e63ba8af688a085 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779745.791203:0:14294:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787779745.791277:0:14294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e741e6c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+12:3304:x1874622525044864:12345-0@lo:103:ldlm_bl.0 Request processed in 245us (3154us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779745.791285:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787779745.791333:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e741e6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:3304:1874622525044864:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787779745.791572:0:14741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e87aa66800/0x9e63ba8af688a046 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9e63ba8af688a03f expref: 11 pid: 14304 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779745.791586:0:14741:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e852b9f840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14741:1874622525044736:0@lo:104: 00010000:00010000:1.0:1787779745.791599:0:14741:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98e87a98aa00/0x9e63ba8af688a085 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779745.791618:0:14741:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98e87a98aa00/0x9e63ba8af688a085 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779745.791624:0:14741:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98e87a98aa00/0x9e63ba8af688a085 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779745.791629:0:14741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e87a98aa00/0x9e63ba8af688a085 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779746.292703:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779747.314870:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787779747.506871:0:14306:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787779747.506881:0:14306:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98e87f66b000 from 10 10000000:01000000:3.0:1787779747.506886:0:14306:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787779747.507122:0:14306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e8429d4a00/0x9e63ba8af688a08c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779747.507136:0:14306:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff98e8429d4a00/0x9e63ba8af688a08c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779747.507149:0:14306:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff98e8429d4a00/0x9e63ba8af688a08c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779747.507175:0:14306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e7435061c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14306:1874622525044992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787779747.507246:0:14306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779747.507297:0:14306:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e87eb429c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787779747.507361:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525044992 00000100:00100000:0.0:1787779747.507369:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525044992 00000100:00100000:0.0:1787779747.507427:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787779747.507437:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e85f557c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+11:14306:x1874622525044992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787779747.507450:0:14303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787779747.507465:0:14303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e848f69e00/0x9e63ba8af688a093 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9e63ba8af688a08c expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779747.507505:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e848f69e00/0x9e63ba8af688a093 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9e63ba8af688a08c expref: 12 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779747.507516:0:14303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e848f69e00/0x9e63ba8af688a093 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af688a08c expref: 12 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779747.507526:0:14303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e848f69e00, rc 0) 00000100:00100000:0.0:1787779747.507575:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e85f557c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+12:14306:x1874622525044992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779747.507582:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787779747.507979:0:14306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e7435061c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14306:1874622525044992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787779747.507998:0:14306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff98e8429d4a00/0x9e63ba8af688a08c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af688a093 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779747.508008:0:14306:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff98e8429d4a00/0x9e63ba8af688a08c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9e63ba8af688a093 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779747.508063:0:14306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e852b9f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14306:1874622525045120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787779747.508095:0:14306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779747.508125:0:14306:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e848e73780 going to sleep for 11 seconds 00000100:00100000:3.0:1787779747.508273:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525045120 00000100:00100000:3.0:1787779747.508278:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525045120 00000100:00100000:3.0:1787779747.508309:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787779747.508316:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e85f557050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+12:14306:x1874622525045120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787779747.508582:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e85f557050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+12:14306:x1874622525045120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 266us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779747.508599:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787779747.508780:0:14306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e852b9f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14306:1874622525045120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787779747.508809:0:14306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e852b9f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14306:1874622525045248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787779747.508844:0:14306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779747.509057:0:14306:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e848e73780 going to sleep for 11 seconds 00000100:00100000:3.0:1787779747.509132:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525045248 00000100:00100000:3.0:1787779747.509138:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525045248 00000100:00100000:3.0:1787779747.509219:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787779747.509227:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e85f556850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+12:14306:x1874622525045248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787779747.509378:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e85f556850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+12:14306:x1874622525045248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 152us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779747.509386:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787779747.509444:0:14306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e852b9f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14306:1874622525045248:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787779747.510420:0:14810:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1787779747.510645:0:14306:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1787779747.510675:0:14306:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787779747.510687:0:14306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e8429d4a00/0x9e63ba8af688a08c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af688a093 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779747.510698:0:14306:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff98e8429d4a00/0x9e63ba8af688a08c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af688a093 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787779747.763507:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787779747.763519:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787779747.763522:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787779747.763525:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787779747.763617:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787779747.763639:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e741e6f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874622525045376:0@lo:400:kworker.0 00000100:00100000:0.0:1787779747.763708:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779747.763859:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525045376 00000100:00100000:2.0:1787779747.763867:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525045376 00000100:00100000:2.0:1787779747.763923:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787779747.763933:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87fdd21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874622525045376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779747.763951:0:3303:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787779737/real 1787779737] req@ffff98e743505680 x1874622525041920/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787779747 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779747.763978:0:3303:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98e743505680 x1874622525041920/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787779747 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779747.763988:0:3303:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787779737/real 1787779737] req@ffff98e743504f00 x1874622525041664/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787779747 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779747.763993:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87fdd21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874622525045376:12345-0@lo:400:kworker.0 Request processed in 59us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779747.764009:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787779747.764014:0:3303:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98e743504f00 x1874622525041664/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787779747 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787779747.764029:0:3303:0:(import.c:65:import_set_state_nolock()) ffff98e846b12800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787779747.764045:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787779747.764050:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e743505680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874622525041920:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1787779747.764052:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787779747.764058:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787779747.764061:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00010000:00080000:0.0:1787779747.764123:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98e741e6f0c0 x1874622525045376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779763 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779747.764137:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e741e6f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874622525045376:0@lo:400:kworker.0 00000100:00080000:2.0:1787779747.764183:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787779747.764243:0:38:0:(import.c:65:import_set_state_nolock()) ffff98e846b12800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787779747.764248:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 503 00000100:00080000:2.0:1787779747.764253:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787779747.764257:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98e846b12800 using connection 192.168.201.109@tcp/0@lo 00000100:00100000:2.0:1787779747.764282:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98e741e6e940 x1874622525045504/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787779747.769954:0:3303:0:(import.c:65:import_set_state_nolock()) ffff98e85f572000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787779747.769983:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787779747.769991:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e743504f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874622525041664:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1787779747.770034:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e741e6e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874622525045504:0@lo:8:kworker.0 00000400:00000100:3.0:1787779747.770105:0:3303:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874622525045504 offset 0 length 520: 4 00000100:00080000:3.0:1787779747.770172:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787779747.770177:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787779747.770180:0:38:0:(import.c:65:import_set_state_nolock()) ffff98e85f572000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787779747.770184:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 503 00000100:00080000:3.0:1787779747.770188:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787779747.770194:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff98e85f572000 using connection 192.168.201.109@tcp/0@lo 00000100:00100000:3.0:1787779747.770224:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98e743504f00 x1874622525045632/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787779747.770324:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e743504f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874622525045632:0@lo:8:kworker.0 00000400:00000100:2.0:1787779747.770349:0:3303:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874622525045632 offset 0 length 520: 4 00010000:00010000:3.0:1787779748.339040:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779749.363290:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787779749.619345:0:14343:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787779750.389372:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787779751.242137:0:14990:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787779751.242141:0:14990:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1787779751.242457:0:14990:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff98e846326800 00000020:01000004:3.0:1787779751.242472:0:14990:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1787779751.242484:0:14990:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1787779751.242496:0:14990:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff98e873b019b8) 00000020:00000080:3.0:1787779751.242510:0:14990:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787779751.271791:0:14990:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787779751.272070:0:14990:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1787779751.273132:0:14990:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787779751.273448:0:14990:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1787779751.273759:0:14990:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1787779751.275117:0:14990:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 83: rc = 0 00100000:10000000:2.0:1787779751.275283:0:14990:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 83: rc = 0 00100000:10000000:2.0:1787779751.275379:0:14990:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 83: rc = 0 00100000:10000000:2.0:1787779751.287171:0:14990:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 605: rc = 0 00100000:10000000:2.0:1787779751.287527:0:14990:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 605: rc = 0 00100000:10000000:2.0:1787779751.287922:0:14990:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 605: rc = 0 00100000:10000000:2.0:1787779751.288293:0:14990:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 605: rc = 0 00100000:10000000:2.0:1787779751.288532:0:14990:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 605: rc = 0 00100000:10000000:2.0:1787779751.289075:0:14990:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 605: rc = 0 00000020:00000080:2.0:1787779751.292569:0:14990:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787779751.292582:0:14990:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787779751.292593:0:14990:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9e63ba8af688a0a1 00000020:01000004:2.0:1787779751.292614:0:14990:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1787779751.292637:0:14990:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.109@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787779751.292640:0:14990:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.109@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787779751.292646:0:14990:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787779751.292661:0:14990:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787779751.292673:0:14990:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff98e844cbb370) 00000020:00000080:2.0:1787779751.292684:0:14990:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1787779751.295877:0:14990:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787779751.296478:0:14990:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787779751.296484:0:14990:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1787779751.306400:0:14990:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1787779751.306413:0:14990:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1787779751.307365:0:14990:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1787779751.307373:0:14990:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1787779751.308745:0:14990:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787779751.309323:0:14990:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1787779751.309330:0:14990:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1787779751.318895:0:14990:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1787779751.318913:0:14990:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1787779751.343446:0:14990:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787779751.343704:0:14990:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787779751.343735:0:14990:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1787779751.345243:0:14990:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787779751.345251:0:14990:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1787779751.347961:0:14990:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787779751.347975:0:14990:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1787779751.353573:0:14990:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787779751.354250:0:14990:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1787779751.354256:0:14990:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1787779751.365559:0:14990:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1787779751.365574:0:14990:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00010000:00010000:1.0:1787779751.421184:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779751.425700:0:14990:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787779751.425947:0:14990:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1787779751.425954:0:14990:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1787779751.435967:0:14990:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1787779751.435983:0:14990:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1787779751.437315:0:14990:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1787779751.437340:0:14990:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1787779751.437346:0:14990:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.109@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1787779751.454825:0:14990:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.109@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787779751.454861:0:14990:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.109@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1787779751.454865:0:14990:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787779751.454867:0:14990:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787779751.454868:0:14990:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787779751.454869:0:14990:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787779751.454870:0:14990:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787779751.454872:0:14990:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787779751.454873:0:14990:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787779751.454875:0:14990:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787779751.454876:0:14990:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787779751.454880:0:14990:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1787779751.454892:0:14990:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787779751.454893:0:14990:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787779751.454894:0:14990:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787779751.454895:0:14990:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787779751.454896:0:14990:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787779751.454897:0:14990:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787779751.454899:0:14990:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787779751.454900:0:14990:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787779751.454901:0:14990:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787779751.454982:0:14990:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787779751.455004:0:14990:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e743505a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14990:1874622525045760:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787779751.455077:0:14990:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779751.455120:0:14990:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e84975f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787779751.455351:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525045760 00000100:00100000:0.0:1787779751.455358:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525045760 00000100:00100000:0.0:1787779751.455404:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787779751.455412:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ed2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+12:14990:x1874622525045760:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787779751.455451:0:14303:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787779751.455455:0:14303:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1787779751.455460:0:14303:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1787779751.470577:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ed2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+12:14990:x1874622525045760:12345-0@lo:253:mount.lustre.0 Request processed in 15155us (15490us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779751.470592:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787779751.480492:0:14990:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e743505a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14990:1874622525045760:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787779751.480514:0:14990:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787779751.480518:0:14990:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787779751.480519:0:14990:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787779751.480520:0:14990:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787779751.480522:0:14990:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787779751.480523:0:14990:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787779751.480524:0:14990:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787779751.480525:0:14990:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787779751.480527:0:14990:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787779751.480528:0:14990:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787779751.480748:0:14990:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98e846326800 from lustre-OST0000 10000000:01000000:1.0:1787779751.480777:0:14990:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1787779751.480780:0:14990:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787779751.480788:0:14990:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff98e87f03b370 local copy 00010000:00010000:1.0:1787779751.480799:0:14990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e87a98b200/0x9e63ba8af6889f97 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6889f9e expref: -99 pid: 14291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779751.481061:0:14990:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e852b9f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14990:1874622525045888:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787779751.481135:0:14990:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779751.481195:0:14990:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e8450a93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787779751.481623:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525045888 00000100:00100000:0.0:1787779751.481630:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525045888 00000100:00100000:0.0:1787779751.481686:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787779751.481695:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ed2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+12:14990:x1874622525045888:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787779751.482018:0:14990:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e852b9f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14990:1874622525045888:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787779751.482032:0:14990:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.109@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787779751.482180:0:14990:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.109@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787779751.482188:0:14990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e87a98b200/0x9e63ba8af6889f97 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6889f9e expref: -99 pid: 14291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779751.482196:0:14990:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff98e87a98b200/0x9e63ba8af6889f97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6889f9e expref: -99 pid: 14291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787779751.482217:0:14990:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98e846326800 10000000:01000000:1.0:1787779751.482222:0:14990:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787779751.482227:0:14990:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff98e87f03b370 10000000:01000000:1.0:1787779751.482229:0:14990:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1787779751.482232:0:14990:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff98e87f03b370 from 1 10000000:01000000:1.0:1787779751.482241:0:14990:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1787779751.482266:0:14990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e87a98a200/0x9e63ba8af688a0af lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779751.482273:0:14990:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff98e87a98a200/0x9e63ba8af688a0af lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779751.482283:0:14990:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff98e87a98a200/0x9e63ba8af688a0af lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779751.482294:0:14990:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e852b9f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14990:1874622525046016:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787779751.482320:0:14990:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779751.482344:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525046016 00000100:00100000:1.0:1787779751.482348:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525046016 00000100:00100000:1.0:1787779751.482365:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787779751.482371:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ed2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+13:14990:x1874622525046016:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787779751.482379:0:14303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779751.482390:0:14303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e87a98b400/0x9e63ba8af688a0b6 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9e63ba8af688a0af expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779751.482409:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e87a98b400/0x9e63ba8af688a0b6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9e63ba8af688a0af expref: 14 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779751.482419:0:14303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e87a98b400/0x9e63ba8af688a0b6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af688a0af expref: 14 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779751.482426:0:14303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87a98b400, rc 0) 00000100:00100000:1.0:1787779751.482449:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ed2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+14:14990:x1874622525046016:12345-0@lo:101:mount.lustre.0 Request processed in 77us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779751.482455:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787779751.482494:0:14990:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e8450a93c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787779751.482506:0:14990:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e852b9f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14990:1874622525046016:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787779751.482517:0:14990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff98e87a98a200/0x9e63ba8af688a0af lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af688a0b6 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779751.482525:0:14990:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff98e87a98a200/0x9e63ba8af688a0af lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9e63ba8af688a0b6 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787779751.482537:0:14990:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1787779751.482547:0:14990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e87a98a200/0x9e63ba8af688a0af lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af688a0b6 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779751.482553:0:14990:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff98e87a98a200/0x9e63ba8af688a0af lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af688a0b6 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787779751.482558:0:14990:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787779751.482561:0:14990:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787779751.482565:0:14990:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1787779751.482567:0:14990:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787779751.482578:0:14990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e87a98ba00/0x9e63ba8af688a0bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779751.482584:0:14990:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff98e87a98ba00/0x9e63ba8af688a0bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779751.482590:0:14990:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff98e87a98ba00/0x9e63ba8af688a0bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779751.482613:0:14990:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e852b9f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14990:1874622525046144:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787779751.482634:0:14990:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779751.482672:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525046144 00000100:00100000:1.0:1787779751.482676:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525046144 00000100:00100000:1.0:1787779751.482691:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787779751.482696:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ed2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+14:14990:x1874622525046144:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787779751.482702:0:14303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779751.482733:0:14303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e87a98be00/0x9e63ba8af688a0c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9e63ba8af688a0bd expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779751.482747:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e87a98be00/0x9e63ba8af688a0c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9e63ba8af688a0bd expref: 15 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779751.482755:0:14303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e87a98be00/0x9e63ba8af688a0c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af688a0bd expref: 15 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779751.482761:0:14303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87a98be00, rc 0) 00000100:00100000:1.0:1787779751.482784:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ed2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+15:14990:x1874622525046144:12345-0@lo:101:mount.lustre.0 Request processed in 87us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779751.482789:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787779751.482811:0:14990:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e846246780 going to sleep for 11 seconds 00000100:00100000:1.0:1787779751.482821:0:14990:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e852b9f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14990:1874622525046144:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787779751.482831:0:14990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff98e87a98ba00/0x9e63ba8af688a0bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af688a0c4 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779751.482839:0:14990:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff98e87a98ba00/0x9e63ba8af688a0bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9e63ba8af688a0c4 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779751.483106:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ed2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+14:14990:x1874622525045888:12345-0@lo:501:mount.lustre.0 Request processed in 1410us (1970us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787779751.483113:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000040:00080000:1.0:1787779751.485329:0:14990:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1787779751.486312:0:14990:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787779751.486556:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1787779751.486605:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1787779751.486638:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1787779751.487313:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1787779751.487349:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1787779751.487396:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1787779751.487462:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1787779751.487469:0:14990:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1787779751.487547:0:14990:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e852b9f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14990:1874622525046272:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787779751.487680:0:14990:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779751.487744:0:14990:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e8450a93c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787779751.487813:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525046272 00000100:00100000:2.0:1787779751.487820:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525046272 00000100:00100000:2.0:1787779751.487868:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787779751.487877:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ed2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+14:14990:x1874622525046272:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787779751.488382:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ed2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+14:14990:x1874622525046272:12345-0@lo:501:mount.lustre.0 Request processed in 505us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779751.488390:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787779751.491869:0:14990:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e852b9f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14990:1874622525046272:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787779751.491944:0:14990:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e852b9f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14990:1874622525046400:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787779751.492022:0:14990:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779751.492078:0:14990:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e8450a93c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787779751.492450:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525046400 00000100:00100000:2.0:1787779751.492457:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525046400 00000100:00100000:2.0:1787779751.492510:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787779751.492520:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ed2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+14:14990:x1874622525046400:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787779751.492962:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ed2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+14:14990:x1874622525046400:12345-0@lo:503:mount.lustre.0 Request processed in 442us (939us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779751.492971:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787779751.493276:0:14990:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e852b9f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14990:1874622525046400:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787779751.497551:0:14990:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787779751.497764:0:14990:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e852b9f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14990:1874622525046528:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787779751.497853:0:14990:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779751.497909:0:14990:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e846ae8240 going to sleep for 11 seconds 00000100:00100000:2.0:1787779751.498400:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525046528 00000100:00100000:2.0:1787779751.498407:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525046528 00000100:00100000:2.0:1787779751.498456:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787779751.498465:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ed2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+14:14990:x1874622525046528:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787779751.498798:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ed2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+14:14990:x1874622525046528:12345-0@lo:502:mount.lustre.0 Request processed in 332us (943us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779751.498805:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787779751.499052:0:14990:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e852b9f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14990:1874622525046528:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787779751.499381:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1787779751.499432:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1787779751.499467:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1787779751.499515:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1787779751.499552:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1787779751.499583:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1787779751.499859:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1787779751.499968:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1787779751.500000:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1787779751.500043:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1787779751.500081:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1787779751.500143:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:1.0:1787779751.500413:0:14990:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e852b9f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14990:1874622525046656:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787779751.500467:0:14990:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779751.500551:0:14990:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e846ae8240 going to sleep for 11 seconds 00000100:00100000:0.0:1787779751.510851:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525046656 00000100:00100000:0.0:1787779751.510867:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525046656 00000100:00100000:1.0:1787779751.513990:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787779751.514007:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ed2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+14:14990:x1874622525046656:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787779751.514307:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ed2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+14:14990:x1874622525046656:12345-0@lo:502:mount.lustre.0 Request processed in 304us (13839us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779751.514315:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787779751.514421:0:14990:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e852b9f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14990:1874622525046656:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787779751.514538:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1787779751.514553:0:14990:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:0.0:1787779751.516105:0:15004:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787779751.516115:0:15004:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1787779751.516128:0:15004:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787779751.516130:0:15004:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1787779751.516136:0:15004:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787779751.516151:0:15004:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff98e874593370) 00000020:00000080:0.0:1787779751.516184:0:15004:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787779751.516191:0:15004:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787779751.516302:0:15004:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98e846326800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1787779751.516311:0:15004:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787779751.516316:0:15004:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9e63ba8af688a0d2 00010000:00010000:0.0:1787779751.525421:0:15004:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:2.0:1787779751.526307:0:15004:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:2.0:1787779751.534300:0:15004:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1787779751.536363:0:15004:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1787779751.536374:0:15004:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787779751.536380:0:15004:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787779751.536382:0:15004:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1787779751.536385:0:15004:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787779751.536387:0:15004:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1787779751.536389:0:15004:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787779751.536390:0:15004:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787779751.536392:0:15004:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787779751.536394:0:15004:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787779751.536395:0:15004:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787779751.536398:0:15004:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787779751.536401:0:15004:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787779751.536402:0:15004:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787779751.536405:0:15004:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787779751.536407:0:15004:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787779751.536409:0:15004:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787779751.536411:0:15004:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787779751.536412:0:15004:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787779751.536415:0:15004:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787779751.536417:0:15004:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787779751.536418:0:15004:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787779751.536422:0:15004:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1787779751.536477:0:15004:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787779751.536488:0:15004:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787779751.536490:0:15004:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787779751.536493:0:15004:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1787779751.536657:0:14990:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1787779751.536686:0:14990:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787779751.536708:0:14990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e87a98ba00/0x9e63ba8af688a0bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af688a0c4 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779751.536752:0:14990:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff98e87a98ba00/0x9e63ba8af688a0bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af688a0c4 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787779751.536767:0:14990:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98e846326800 from 1 10000000:01000000:3.0:1787779751.536770:0:14990:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787779751.536810:0:14990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e8429d5600/0x9e63ba8af688a0d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779751.536819:0:14990:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff98e8429d5600/0x9e63ba8af688a0d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779751.536831:0:14990:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff98e8429d5600/0x9e63ba8af688a0d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779751.536858:0:14990:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e743507480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14990:1874622525046784:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787779751.536933:0:14990:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779751.536971:0:14990:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e848f400c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787779751.537080:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525046784 00000100:00100000:1.0:1787779751.537087:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525046784 00000100:00100000:1.0:1787779751.537133:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787779751.537143:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ed2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+14:14990:x1874622525046784:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787779751.537154:0:14304:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779751.537167:0:14304:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e87a98b600/0x9e63ba8af688a0e0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9e63ba8af688a0d9 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779751.537190:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e87a98b600/0x9e63ba8af688a0e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9e63ba8af688a0d9 expref: 15 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779751.537200:0:14304:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e87a98b600/0x9e63ba8af688a0e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af688a0d9 expref: 15 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779751.537209:0:14304:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87a98b600, rc 0) 00000100:00100000:1.0:1787779751.537246:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ed2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+15:14990:x1874622525046784:12345-0@lo:101:mount.lustre.0 Request processed in 105us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779751.537259:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787779751.541578:0:14990:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e743507480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14990:1874622525046784:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787779751.541612:0:14990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff98e8429d5600/0x9e63ba8af688a0d9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af688a0e0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779751.541625:0:14990:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff98e8429d5600/0x9e63ba8af688a0d9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9e63ba8af688a0e0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787779751.542245:0:14990:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1787779751.542740:0:14990:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787779751.542958:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1787779751.542999:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1787779751.543056:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1787779751.543064:0:14990:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1787779751.543137:0:14990:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e743507480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14990:1874622525046912:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787779751.543209:0:14990:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779751.543251:0:14990:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e848f400c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787779751.547065:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525046912 00000100:00100000:1.0:1787779751.547080:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525046912 00000100:00100000:1.0:1787779751.547136:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787779751.547146:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ed2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+15:14990:x1874622525046912:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787779751.549250:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ed2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+15:14990:x1874622525046912:12345-0@lo:501:mount.lustre.0 Request processed in 2098us (6033us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779751.549262:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787779751.549415:0:14990:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e743507480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14990:1874622525046912:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787779751.549463:0:14990:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e743507480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14990:1874622525047040:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787779751.549508:0:14990:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779751.549541:0:14990:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e848f400c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787779751.549780:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525047040 00000100:00100000:2.0:1787779751.549785:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525047040 00000100:00100000:2.0:1787779751.549818:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787779751.549826:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ed2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+15:14990:x1874622525047040:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787779751.550294:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ed2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+15:14990:x1874622525047040:12345-0@lo:503:mount.lustre.0 Request processed in 467us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779751.550302:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787779751.550382:0:14990:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e743507480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14990:1874622525047040:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787779751.554442:0:14990:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787779751.554545:0:14990:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e743507480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14990:1874622525047168:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787779751.554670:0:14990:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779751.554742:0:14990:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e848f400c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787779751.554845:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525047168 00000100:00100000:1.0:1787779751.554852:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525047168 00000100:00100000:1.0:1787779751.554909:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787779751.554918:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+15:14990:x1874622525047168:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787779751.555124:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+15:14990:x1874622525047168:12345-0@lo:502:mount.lustre.0 Request processed in 206us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779751.555131:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787779751.555358:0:14990:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e743507480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14990:1874622525047168:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787779751.555622:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1787779751.555686:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1787779751.556063:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1787779751.556102:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1787779751.556135:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1787779751.556317:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1787779751.556356:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1787779751.556387:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1787779751.556418:0:14990:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e743507480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14990:1874622525047296:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787779751.556468:0:14990:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779751.556545:0:14990:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e848f400c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787779751.562145:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525047296 00000100:00100000:2.0:1787779751.562169:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525047296 00000100:00100000:2.0:1787779751.562221:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787779751.562232:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+15:14990:x1874622525047296:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787779751.562514:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+15:14990:x1874622525047296:12345-0@lo:502:mount.lustre.0 Request processed in 284us (6044us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779751.562522:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787779751.562657:0:14990:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e743507480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14990:1874622525047296:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787779751.562840:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1787779751.562862:0:14990:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1787779751.566223:0:15008:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787779751.566238:0:15008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787779751.566241:0:15008:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787779751.566250:0:15008:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98e846326800 00000020:00000080:3.0:1787779751.566252:0:15008:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787779751.566260:0:15008:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787779751.566262:0:15008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787779751.566264:0:15008:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787779751.566266:0:15008:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787779751.566267:0:15008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787779751.566269:0:15008:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787779751.566271:0:15008:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98e846326800 00000020:00000080:3.0:1787779751.566273:0:15008:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787779751.566324:0:15008:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787779751.566327:0:15008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787779751.566329:0:15008:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787779751.566331:0:15008:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787779751.566334:0:15008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787779751.566335:0:15008:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787779751.566338:0:15008:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98e846326800 00000020:00000080:3.0:1787779751.566340:0:15008:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787779751.566381:0:15008:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787779751.566385:0:15008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787779751.566386:0:15008:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787779751.566389:0:15008:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1787779751.576786:0:14990:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1787779751.576832:0:14990:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787779751.576863:0:14990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e8429d5600/0x9e63ba8af688a0d9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af688a0e0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779751.576875:0:14990:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff98e8429d5600/0x9e63ba8af688a0d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af688a0e0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787779751.576930:0:14990:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787779751.576932:0:14990:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98e846326800 10000000:01000000:1.0:1787779751.576935:0:14990:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98e846326800 10000000:01000000:1.0:1787779751.576938:0:14990:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787779751.576951:0:14990:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98e846326800 from 1 10000000:01000000:1.0:1787779751.576953:0:14990:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787779751.576988:0:14990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e87a98bc00/0x9e63ba8af688a0e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779751.576997:0:14990:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff98e87a98bc00/0x9e63ba8af688a0e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779751.577007:0:14990:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff98e87a98bc00/0x9e63ba8af688a0e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779751.577031:0:14990:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e852b9cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14990:1874622525047424:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787779751.577097:0:14990:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779751.577142:0:14990:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e846ae8480 going to sleep for 11 seconds 00000100:00100000:2.0:1787779751.577876:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525047424 00000100:00100000:2.0:1787779751.577892:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525047424 00000100:00100000:2.0:1787779751.577936:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787779751.577945:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+15:14990:x1874622525047424:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787779751.577958:0:14304:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779751.577972:0:14304:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e87aa67800/0x9e63ba8af688a0ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9e63ba8af688a0e7 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779751.577996:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e87aa67800/0x9e63ba8af688a0ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9e63ba8af688a0e7 expref: 16 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779751.578007:0:14304:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e87aa67800/0x9e63ba8af688a0ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af688a0e7 expref: 16 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779751.578015:0:14304:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87aa67800, rc 0) 00000100:00100000:2.0:1787779751.578073:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+16:14990:x1874622525047424:12345-0@lo:101:mount.lustre.0 Request processed in 129us (976us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779751.578080:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787779751.578557:0:14990:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e852b9cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14990:1874622525047424:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787779751.578574:0:14990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff98e87a98bc00/0x9e63ba8af688a0e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af688a0ee expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779751.578584:0:14990:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff98e87a98bc00/0x9e63ba8af688a0e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9e63ba8af688a0ee expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787779751.579609:0:14990:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1787779751.585985:0:14990:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787779751.587586:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1787779751.587675:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1787779751.587745:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1787779751.587798:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1787779751.587839:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1787779751.590355:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1787779751.590435:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1787779751.590482:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1787779751.590549:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1787779751.590586:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1787779751.590618:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1787779751.590674:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1787779751.590750:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1787779751.590788:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1787779751.590838:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1787779751.590877:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1787779751.593407:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1787779751.593475:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1787779751.593511:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1787779751.593542:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1787779751.593584:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1787779751.593808:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1787779751.593842:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1787779751.595115:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1787779751.595189:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1787779751.595224:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1787779751.595274:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1787779751.595311:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1787779751.595418:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1787779751.595427:0:14990:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1787779751.595523:0:14990:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e852b9cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14990:1874622525047552:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787779751.596850:0:14990:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779751.596959:0:14990:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e846ae8480 going to sleep for 11 seconds 00000100:00100000:0.0:1787779751.597705:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525047552 00000100:00100000:0.0:1787779751.597725:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525047552 00000100:00100000:0.0:1787779751.597778:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787779751.597787:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+16:14990:x1874622525047552:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787779751.598074:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+16:14990:x1874622525047552:12345-0@lo:501:mount.lustre.0 Request processed in 288us (2486us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779751.598082:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787779751.598845:0:14990:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e852b9cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14990:1874622525047552:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787779751.598900:0:14990:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e852b9cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14990:1874622525047680:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787779751.598946:0:14990:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779751.598973:0:14990:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e846ae8480 going to sleep for 11 seconds 00000100:00100000:2.0:1787779751.599732:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525047680 00000100:00100000:2.0:1787779751.599740:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525047680 00000100:00100000:2.0:1787779751.599780:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787779751.599789:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+16:14990:x1874622525047680:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787779751.599967:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+16:14990:x1874622525047680:12345-0@lo:503:mount.lustre.0 Request processed in 178us (1020us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779751.599982:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787779751.601294:0:14990:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e852b9cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14990:1874622525047680:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787779751.605685:0:14990:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787779751.605804:0:14990:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e852b9cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14990:1874622525047808:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787779751.605881:0:14990:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779751.605925:0:14990:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e846ae8480 going to sleep for 11 seconds 00000100:00100000:2.0:1787779751.606271:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525047808 00000100:00100000:2.0:1787779751.606278:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525047808 00000100:00100000:2.0:1787779751.606331:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787779751.606340:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+16:14990:x1874622525047808:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787779751.606562:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+16:14990:x1874622525047808:12345-0@lo:502:mount.lustre.0 Request processed in 222us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779751.606571:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787779751.607270:0:14990:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e852b9cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14990:1874622525047808:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787779751.607551:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1787779751.607624:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1787779751.607674:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1787779751.607751:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1787779751.607789:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1787779751.607846:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1787779751.608014:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1787779751.608055:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1787779751.608105:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1787779751.608141:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1787779751.612098:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1787779751.612232:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1787779751.612283:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1787779751.612317:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1787779751.612364:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1787779751.612400:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1787779751.612432:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1787779751.612477:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1787779751.612512:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1787779751.612547:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1787779751.614269:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1787779751.614359:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1787779751.614396:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1787779751.614460:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1787779751.614514:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1787779751.614549:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1787779751.617187:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1787779751.617273:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1787779751.617321:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1787779751.617367:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1787779751.617401:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1787779751.617432:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1787779751.617466:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1787779751.617517:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1787779751.617549:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1787779751.619342:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1787779751.619423:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1787779751.619459:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1787779751.619518:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1787779751.619556:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1787779751.619622:0:14990:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e852b9cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14990:1874622525047936:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787779751.619734:0:14990:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779751.619779:0:14990:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e846ae8480 going to sleep for 11 seconds 00000100:00100000:0.0:1787779751.619872:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525047936 00000100:00100000:0.0:1787779751.619887:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525047936 00000100:00100000:0.0:1787779751.619941:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787779751.619950:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+16:14990:x1874622525047936:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787779751.620173:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+16:14990:x1874622525047936:12345-0@lo:502:mount.lustre.0 Request processed in 223us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779751.620180:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787779751.621887:0:14990:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e852b9cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14990:1874622525047936:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787779751.622029:0:14990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1787779751.622052:0:14990:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1787779751.633113:0:15013:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1787779751.633133:0:15013:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff98e842f1b370) 00000020:00000080:1.0:1787779751.633156:0:15013:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1787779751.633375:0:15013:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98e846326800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787779751.633381:0:15013:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98e846326800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787779751.633383:0:15013:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98e846326800 3 00010000:00080000:1.0:1787779751.633414:0:15013:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98e848fee000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.109@tcp at head 00010000:00010000:0.0:1787779751.638516:0:15013:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:0.0:1787779751.638863:0:15013:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1787779751.638969:0:15013:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787779751.638983:0:15013:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x9e63ba8af688a0fc 00000100:00080000:0.0:1787779751.638993:0:15013:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787779751.639000:0:15013:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98e848fee000 using connection 192.168.201.109@tcp/0@lo 00000100:00100000:0.0:1787779751.639038:0:15013:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98e87fdd03c0 x1874622525048064/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787779751.639068:0:15013:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787779751.640743:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787779751.640764:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787779751.640768:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787779751.640771:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787779751.640833:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787779751.640849:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e852b9cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874622525048192:0@lo:400:kworker.0 00000100:00100000:1.0:1787779751.640928:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779751.640982:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525048192 00000100:00100000:1.0:1787779751.640988:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525048192 00000100:00100000:1.0:1787779751.641031:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787779751.641040:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e852b9e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874622525048192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779751.641090:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e852b9e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874622525048192:12345-0@lo:400:kworker.0 Request processed in 51us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779751.641097:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787779751.641138:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98e852b9cb40 x1874622525048192/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779767 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779751.641150:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e852b9cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874622525048192:0@lo:400:kworker.0 00000100:00100000:3.0:1787779751.641350:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87fdd03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1874622525048064:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787779751.641383:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779751.642559:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525048064 00000100:00100000:1.0:1787779751.642568:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525048064 00000100:00100000:1.0:1787779751.642610:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787779751.642626:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e743507480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3303:x1874622525048064:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1787779751.642660:0:14311:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 517 last 0 00000020:00000080:1.0:1787779751.642700:0:14311:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x9e63ba8af688a103 00000004:00100000:1.0:1787779751.642737:0:14311:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787779751.642769:0:14311:0:(import.c:65:import_set_state_nolock()) ffff98e848fe8000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787779751.642825:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e743507480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874622525048064:12345-0@lo:38:llog_process_th.0 Request processed in 197us (1440us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779751.642842:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787779751.643046:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98e87fdd03c0 x1874622525048064/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787779761 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779751.643058:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787779751.643065:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1787779751.643073:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787779751.643077:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787779751.643080:0:3303:0:(import.c:65:import_set_state_nolock()) ffff98e848fee000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787779751.643085:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87fdd03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1874622525048064:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1787779751.643517:0:15013:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1787779751.644626:0:14990:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1787779751.644670:0:14990:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787779751.644691:0:14990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e87a98bc00/0x9e63ba8af688a0e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af688a0ee expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779751.644702:0:14990:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff98e87a98bc00/0x9e63ba8af688a0e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af688a0ee expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787779751.644784:0:14990:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787779751.644786:0:14990:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787779751.644787:0:14990:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787779751.644789:0:14990:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787779751.644791:0:14990:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787779751.644792:0:14990:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787779751.644794:0:14990:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787779751.644795:0:14990:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787779751.644797:0:14990:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787779751.644800:0:14990:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1787779751.644803:0:14990:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787779751.644804:0:14990:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787779751.644811:0:14990:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787779751.644812:0:14990:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787779751.644813:0:14990:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787779751.644815:0:14990:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787779751.644815:0:14990:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787779751.644816:0:14990:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787779751.644818:0:14990:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787779751.644841:0:14990:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787779751.644858:0:14990:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e852b9cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14990:1874622525048320:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787779751.644927:0:14990:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779751.644965:0:14990:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e846ae8240 going to sleep for 11 seconds 00000100:00100000:3.0:1787779751.645137:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525048320 00000100:00100000:3.0:1787779751.645143:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525048320 00000100:00100000:3.0:1787779751.645193:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787779751.645203:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+16:14990:x1874622525048320:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787779751.645235:0:14303:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787779751.645248:0:14303:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787779751.705347:0:14303:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787779751.705363:0:14303:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1787779751.706611:0:14325:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787779751.706619:0:14325:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787779751.706640:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98e87aa66e00/0x9e63ba8af688a10a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779751.706669:0:14325:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98e8429d5a00/0x9e63ba8af688a077 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af688a070 expref: 16 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779751.706679:0:14325:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98e87aa66e00/0x9e63ba8af688a10a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779751.706765:0:14325:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98e8429d5a00/0x9e63ba8af688a077 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9e63ba8af688a070 expref: 16 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779751.706779:0:14325:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98e8429d5a00/0x9e63ba8af688a077 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9e63ba8af688a070 expref: 16 pid: 14301 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779751.706794:0:14325:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e741e6d2c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14325:1874622525048448:0@lo:104: 00000100:00100000:2.0:1787779751.706863:0:14325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779751.707065:0:14325:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e84764e900 going to sleep for 11 seconds 00000100:00100000:3.0:1787779751.717413:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+16:14990:x1874622525048320:12345-0@lo:253:mount.lustre.0 Request processed in 72200us (72474us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779751.717429:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787779751.717550:0:14990:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e852b9cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14990:1874622525048320:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787779751.717574:0:14990:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787779751.717578:0:14990:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787779751.717580:0:14990:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787779751.717581:0:14990:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787779751.717582:0:14990:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787779751.717583:0:14990:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787779751.717584:0:14990:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787779751.717586:0:14990:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787779751.717597:0:14990:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787779751.717599:0:14990:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787779751.717614:0:14990:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1787779751.721020:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525048448 00000100:00100000:0.0:1787779751.721044:0:14292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525048448 00000100:00100000:0.0:1787779751.721106:0:14292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787779751.721116:0:14292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e741e6cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+3:14325:x1874622525048448:12345-0@lo:104: 00010000:00010000:0.0:1787779751.721133:0:14292:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.109@tcp lock: ffff98e848f68c00/0x9e63ba8af688a070 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9e63ba8af688a077 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779751.721233:0:14292:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787779751.721238:0:14292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e741e6cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+3:14325:x1874622525048448:12345-0@lo:104: Request processed in 125us (14376us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779751.721245:0:14292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787779751.721373:0:14325:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e741e6d2c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14325:1874622525048448:0@lo:104: 00010000:00010000:1.0:1787779751.721395:0:14325:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98e87aa66e00/0x9e63ba8af688a10a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779751.721591:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787779751.721598:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff98e848f68c00/0x9e63ba8af688a070 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9e63ba8af688a077 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779751.721606:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e848f68c00 already unused, calling callback (ffffffffc1cd5c20) 10000000:00010000:3.0:1787779751.721610:0:14298:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff98e848f68c00/0x9e63ba8af688a070 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9e63ba8af688a077 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779751.721619:0:14298:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff98e848f68c00/0x9e63ba8af688a070 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9e63ba8af688a077 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787779751.721626:0:14298:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff98e848f68c00/0x9e63ba8af688a070 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9e63ba8af688a077 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787779751.721632:0:14298:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787779751.721682:0:14298:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.109@tcp lock: ffff98e848f68c00/0x9e63ba8af688a070 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af688a077 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779751.721688:0:14298:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787779751.721738:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff98e848f68c00/0x9e63ba8af688a070 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af688a077 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779751.721746:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff98e848f68c00/0x9e63ba8af688a070 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af688a077 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779751.721771:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787779751.721772:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787779751.721774:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779751.721784:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787779751.721963:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e743504b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:3305:1874622525048576:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787779751.722001:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779751.722074:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525048576 00000100:00100000:1.0:1787779751.722078:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525048576 00010000:00010000:1.0:1787779751.722096:0:14296:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98e8429d5a00/0x9e63ba8af688a077 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9e63ba8af688a070 expref: 16 pid: 14301 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779751.722121:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787779751.722128:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e743506580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+16:3305:x1874622525048576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787779751.722137:0:14296:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787779751.722142:0:14296:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98e8429d5a00/0x9e63ba8af688a077 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9e63ba8af688a070 expref: 16 pid: 14301 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779751.722160:0:14296:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98e8429d5a00/0x9e63ba8af688a077 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9e63ba8af688a070 expref: 16 pid: 14301 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779751.722173:0:14296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e8429d5a00/0x9e63ba8af688a077 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9e63ba8af688a070 expref: 16 pid: 14301 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779751.722195:0:14296:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98e87aa66e00/0x9e63ba8af688a10a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779751.722204:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e87aa66e00/0x9e63ba8af688a10a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787779751.722217:0:14296:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.015599279s 00010000:00010000:1.0:1787779751.722222:0:14296:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98e87aa66e00/0x9e63ba8af688a10a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779751.722228:0:14296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98e87aa66e00/0x9e63ba8af688a10a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779751.722236:0:14296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98e87aa66e00/0x9e63ba8af688a10a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779751.722242:0:14296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98e87aa66e00/0x9e63ba8af688a10a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779751.722248:0:14296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87aa66e00 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:1.0:1787779751.722251:0:14296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98e87aa66e00/0x9e63ba8af688a10a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779751.722259:0:14296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98e87aa66e00/0x9e63ba8af688a10a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779751.722270:0:14296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98e87aa66e00/0x9e63ba8af688a10a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779751.722278:0:14296:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787779751.722309:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e743506580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+15:3305:x1874622525048576:12345-0@lo:103:ldlm_bl.0 Request processed in 181us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779751.722315:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1787779751.722333:0:14325:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98e87aa66e00/0x9e63ba8af688a10a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779751.722340:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98e87aa66e00/0x9e63ba8af688a10a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779751.722347:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e87aa66e00/0x9e63ba8af688a10a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779751.722857:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e743504b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:3305:1874622525048576:0@lo:103:ldlm_bl.0 00080000:10000000:3.0:1787779751.726433:0:14990:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1787779751.726593:0:14990:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787779751.726783:0:14990:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1787779751.727186:0:14990:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787779751.727330:0:14990:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1787779751.727542:0:14990:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1787779751.752052:0:14990:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1787779751.854118:0:14990:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1787779751.854127:0:14990:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1787779751.854169:0:14990:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787779751.854225:0:14990:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.109@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787779751.854240:0:14990:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1787779751.854267:0:14990:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1787779752.435123:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787779753.011369:0:14306:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787779753.011379:0:14306:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98e87f66b000 from 7 10000000:01000000:1.0:1787779753.011384:0:14306:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787779753.011431:0:14306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e87a98a000/0x9e63ba8af688a111 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779753.011443:0:14306:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff98e87a98a000/0x9e63ba8af688a111 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779753.011454:0:14306:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff98e87a98a000/0x9e63ba8af688a111 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779753.011480:0:14306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e852b9d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14306:1874622525048704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787779753.011547:0:14306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779753.011600:0:14306:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e845f4fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787779753.012370:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525048704 00000100:00100000:0.0:1787779753.012379:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525048704 00000100:00100000:0.0:1787779753.012429:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787779753.012439:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e84517e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+15:14306:x1874622525048704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787779753.012453:0:14304:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787779753.012466:0:14304:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e848f68800/0x9e63ba8af688a118 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9e63ba8af688a111 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779753.012489:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e848f68800/0x9e63ba8af688a118 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9e63ba8af688a111 expref: 16 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779753.012499:0:14304:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e848f68800/0x9e63ba8af688a118 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af688a111 expref: 16 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779753.012508:0:14304:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e848f68800, rc 0) 00000100:00100000:0.0:1787779753.012553:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e84517e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+16:14306:x1874622525048704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (1006us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779753.012560:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787779753.012606:0:14306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e852b9d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14306:1874622525048704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787779753.012640:0:14306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff98e87a98a000/0x9e63ba8af688a111 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af688a118 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779753.012650:0:14306:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff98e87a98a000/0x9e63ba8af688a111 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9e63ba8af688a118 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779753.012705:0:14306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87fdd1680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14306:1874622525048832:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787779753.012754:0:14306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779753.012778:0:14306:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e8521e00c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787779753.013779:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525048832 00000100:00100000:3.0:1787779753.013786:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525048832 00000100:00100000:3.0:1787779753.013821:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787779753.013829:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e84517d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+16:14306:x1874622525048832:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787779753.013847:0:14303:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787779753.013863:0:14303:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787779753.013866:0:14303:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1787779753.013957:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e84517d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+16:14306:x1874622525048832:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 129us (1201us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779753.013965:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787779753.018237:0:14306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87fdd1680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14306:1874622525048832:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787779753.018331:0:14306:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787779753.018342:0:14306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e87a98a000/0x9e63ba8af688a111 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af688a118 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779753.018354:0:14306:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff98e87a98a000/0x9e63ba8af688a111 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af688a118 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779753.460974:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779754.484063:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779755.512150:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779756.531317:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787779756.979977:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787779756.979984:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787779756.979997:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787779756.980000:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787779756.980066:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e743504b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:3305:1874622525048960:0@lo:400:kworker.0 00000100:00100000:3.0:1787779756.980146:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779756.980211:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e7435070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874622525049088:0@lo:400:kworker.0 00000100:00100000:3.0:1787779756.980239:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779756.980261:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787779756.980267:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e743505e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874622525049216:0@lo:400:kworker.0 00000100:00100000:3.0:1787779756.980288:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779756.980322:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525048960 00000100:00100000:3.0:1787779756.980328:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525048960 00000100:00100000:3.0:1787779756.980387:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787779756.980395:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e84517cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+16:3305:x1874622525048960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779756.980455:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e84517cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+16:3305:x1874622525048960:12345-0@lo:400:kworker.0 Request processed in 60us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779756.980461:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787779756.980506:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525049088 00000100:00100000:3.0:1787779756.980510:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525049088 00000100:00100000:3.0:1787779756.980540:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525049216 00000100:00100000:3.0:1787779756.980543:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525049216 00000100:00100000:3.0:1787779756.980583:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787779756.980589:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e743507c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874622525049088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779756.980633:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e743507c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874622525049088:12345-0@lo:400:kworker.0 Request processed in 44us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779756.980639:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787779756.980652:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787779756.980666:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e743504000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874622525049216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779756.980695:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e743504000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874622525049216:12345-0@lo:400:kworker.0 Request processed in 30us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779756.980701:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1787779756.980762:0:14305:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787779756.981074:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98e743505e00 x1874622525049216/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779772 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779756.981088:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e743505e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874622525049216:0@lo:400:kworker.0 00010000:00080000:3.0:1787779756.981100:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98e7435070c0 x1874622525049088/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779772 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779756.981109:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e7435070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874622525049088:0@lo:400:kworker.0 00000100:00100000:3.0:1787779756.981174:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e743504b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:3305:1874622525048960:0@lo:400:kworker.0 00010000:00010000:1.0:1787779757.556002:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779758.579688:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787779759.371561:0:15357:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg109-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787779759.603868:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787779759.863983:0:14343:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787779760.626880:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779761.650954:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787779762.101057:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787779762.101062:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787779762.101065:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787779762.101067:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787779762.101113:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787779762.101142:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87fdd0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874622525049600:0@lo:400:kworker.0 00000100:00100000:0.0:1787779762.101199:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779762.103078:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87fdd2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:3304:1874622525049344:0@lo:400:kworker.0 00000100:00100000:3.0:1787779762.103137:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779762.103180:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787779762.103188:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87fdd30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874622525049472:0@lo:400:kworker.0 00000100:00100000:3.0:1787779762.103216:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779762.103263:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525049600 00000100:00100000:3.0:1787779762.103270:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525049600 00000100:00100000:3.0:1787779762.103327:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525049472 00000100:00100000:3.0:1787779762.103331:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525049472 00000100:00100000:3.0:1787779762.103352:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787779762.103362:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87fdd0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874622525049600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779762.103434:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87fdd0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874622525049600:12345-0@lo:400:kworker.0 Request processed in 73us (2232us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779762.103442:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787779762.103479:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787779762.103486:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e743505e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874622525049472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779762.103526:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e743505e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874622525049472:12345-0@lo:400:kworker.0 Request processed in 41us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779762.103532:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1787779762.103612:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98e87fdd30c0 x1874622525049472/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779778 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779762.103747:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525049344 00000100:00100000:3.0:1787779762.103751:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525049344 00000100:00100000:3.0:1787779762.103777:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787779762.103786:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e84517fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+16:3304:x1874622525049344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779762.103804:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87fdd30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874622525049472:0@lo:400:kworker.0 00000100:00100000:3.0:1787779762.103831:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e84517fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+16:3304:x1874622525049344:12345-0@lo:400:kworker.0 Request processed in 45us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779762.103835:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87fdd2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:3304:1874622525049344:0@lo:400:kworker.0 00000100:00100000:3.0:1787779762.103844:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:3.0:1787779762.103876:0:14305:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787779762.103903:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98e87fdd0780 x1874622525049600/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779778 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779762.103915:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87fdd0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874622525049600:0@lo:400:kworker.0 00010000:00010000:0.0:1787779762.675549:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787779762.931293:0:3303:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787779747/real 1787779747] req@ffff98e743504f00 x1874622525045632/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787779762 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779762.931327:0:3303:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98e743504f00 x1874622525045632/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787779762 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779762.931338:0:3303:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787779747/real 1787779747] req@ffff98e741e6e940 x1874622525045504/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787779762 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779762.931350:0:3303:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98e741e6e940 x1874622525045504/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787779762 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787779762.931367:0:3303:0:(import.c:65:import_set_state_nolock()) ffff98e85f572000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787779762.931407:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787779762.931411:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e743504f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874622525045632:0@lo:8:kworker.0 00000100:00080000:2.0:1787779762.931417:0:3303:0:(import.c:65:import_set_state_nolock()) ffff98e846b12800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787779762.931421:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787779762.931424:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e741e6e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874622525045504:0@lo:8:kworker.0 00000100:00080000:3.0:1787779762.932812:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787779762.932818:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787779762.932822:0:8:0:(import.c:65:import_set_state_nolock()) ffff98e85f572000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787779762.932829:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 513 00000100:00080000:3.0:1787779762.932835:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787779762.932841:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff98e85f572000 using connection 192.168.201.109@tcp/0@lo 00000100:00100000:3.0:1787779762.932874:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98e743504780 x1874622525049856/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787779762.932896:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787779762.932900:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787779762.932902:0:8:0:(import.c:65:import_set_state_nolock()) ffff98e846b12800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787779762.932905:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 513 00000100:00080000:3.0:1787779762.932908:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787779762.932911:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98e846b12800 using connection 192.168.201.109@tcp/0@lo 00000100:00100000:3.0:1787779762.932922:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98e743507840 x1874622525049984/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787779762.932975:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e743504f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874622525050112:0@lo:400:kworker.0 00000100:00100000:3.0:1787779762.933051:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779762.933084:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787779762.933101:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e743506d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:3306:1874622525049728:0@lo:400:kworker.0 00000100:00100000:3.0:1787779762.933114:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787779762.933123:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e7435070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874622525050240:0@lo:400:kworker.0 00000100:00100000:2.0:1787779762.933357:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e743504780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874622525049856:0@lo:8:kworker.0 00000100:00100000:3.0:1787779762.935207:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779762.935896:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525050112 00000100:00100000:0.0:1787779762.935906:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525050112 00000100:00100000:0.0:1787779762.935954:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525050240 00000100:00100000:0.0:1787779762.935956:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525050240 00000100:00100000:0.0:1787779762.935972:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787779762.935980:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e743504b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874622525050112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779762.936051:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e743504b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874622525050112:12345-0@lo:400:kworker.0 Request processed in 72us (2999us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779762.936058:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787779762.936074:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787779762.936079:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e743505680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874622525050240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779762.936103:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e743505680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874622525050240:12345-0@lo:400:kworker.0 Request processed in 24us (900us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779762.936109:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1787779762.937169:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98e7435070c0 x1874622525050240/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779778 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779762.937186:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e7435070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874622525050240:0@lo:400:kworker.0 00010000:00080000:3.0:1787779762.937200:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98e743504f00 x1874622525050112/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779778 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779762.937209:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e743504f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874622525050112:0@lo:400:kworker.0 00000100:00100000:1.0:1787779762.937662:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779762.937785:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525049728 00000100:00100000:3.0:1787779762.937791:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525049728 00000100:00100000:3.0:1787779762.937840:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787779762.937859:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e84517dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+16:3306:x1874622525049728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779762.937927:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e84517dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+16:3306:x1874622525049728:12345-0@lo:400:kworker.0 Request processed in 69us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779762.937934:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787779762.938051:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e743506d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:3306:1874622525049728:0@lo:400:kworker.0 00000100:00100000:2.0:1787779762.938403:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779762.938465:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e743507840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874622525049984:0@lo:8:kworker.0 00000100:00100000:2.0:1787779762.938491:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779762.938633:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525049856 00000100:00100000:3.0:1787779762.938637:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525049856 00000100:00100000:3.0:1787779762.938660:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525049984 00000100:00100000:3.0:1787779762.938662:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525049984 00000100:00100000:3.0:1787779762.938672:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787779762.938678:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e741e6e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3303:x1874622525049856:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1787779762.938702:0:14991:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 528 last 0 00000020:00000080:3.0:1787779762.938761:0:14991:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9e63ba8af688a11f 00002000:00100000:3.0:1787779762.938776:0:14991:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff98e846b14000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113939 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1787779762.938781:0:14991:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1787779762.938783:0:14991:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787779762.939162:0:14991:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787779762.939187:0:14991:0:(import.c:65:import_set_state_nolock()) ffff98e846b12000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787779762.939415:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e741e6e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1874622525049856:12345-0@lo:8:kworker.0 Request processed in 735us (1010us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779762.939423:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787779762.939515:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787779762.939521:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e741e6da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3303:x1874622525049984:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1787779762.939533:0:14991:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787779762.939559:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e741e6da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3303:x1874622525049984:12345-0@lo:8:kworker.0 Request processed in 38us (1067us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787779762.939565:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787779762.944547:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98e743504780 x1874622525049856/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787779782 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779762.944565:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787779762.944637:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1787779762.944647:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787779762.944666:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1787779762.944669:0:3303:0:(import.c:65:import_set_state_nolock()) ffff98e85f572000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787779762.944705:0:3303:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787779762.944729:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e743504780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874622525049856:0@lo:8:kworker.0 00000100:00080000:0.0:1787779762.944754:0:3303:0:(import.c:65:import_set_state_nolock()) ffff98e846b12800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787779762.944759:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787779762.944762:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e743507840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874622525049984:0@lo:8:kworker.0 00000004:00080000:1.0:1787779762.944918:0:14332:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:1.0:1787779762.944942:0:14332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e852b9e580 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14332:1874622525050496:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1787779762.945009:0:14332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779762.945052:0:14332:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e845d959c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787779762.945081:0:14993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525050496 00000100:00100000:1.0:1787779762.945087:0:14993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525050496 00000100:00100000:1.0:1787779762.945138:0:14993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787779762.945147:0:14993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e852b9d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14332:x1874622525050496:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1787779762.945196:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787779762.945207:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e852b9de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622525050368:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787779762.945242:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787779762.945283:0:14305:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787779762.945310:0:14995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525050368 00000100:00100000:0.0:1787779762.945313:0:14995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525050368 00000100:00100000:0.0:1787779762.945339:0:14995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787779762.945347:0:14995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87fdd2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1874622525050368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787779762.945374:0:14995:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000004:00080000:3.0:1787779762.945516:0:14331:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787779762.945925:0:14331:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 528687212373ns, next at 0ns, rc = 0 00000100:00100000:0.0:1787779762.946533:0:14995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87fdd2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1874622525050368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1183us (1286us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779762.946545:0:14995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787779762.946661:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98e852b9de00 x1874622525050368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779778 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779762.946684:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e852b9de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622525050368:0@lo:13:osp-pre-0-0.0 00002000:00080000:1.0:1787779762.949425:0:14993:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1787779762.949500:0:14993:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1787779762.949505:0:14993:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00002000:00010000:1.0:1787779762.959393:0:14993:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787779762.959406:0:14993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030ec1cf7/0x9e63ba8af688a126 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779762.959425:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=528s v=(0 0) 00010000:00010000:1.0:1787779762.959430:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787779762.959437:0:14993:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030ec1cf7/0x9e63ba8af688a126 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779762.959466:0:14993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000030ec1cf7/0x9e63ba8af688a126 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779762.959490:0:14993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030ec1cf7/0x9e63ba8af688a126 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779762.959498:0:14993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000030ec1cf7/0x9e63ba8af688a126 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779762.959523:0:14993:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787779762.959956:0:14993:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787779762.959963:0:14993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054db027d/0x9e63ba8af688a12d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779762.959972:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=528s v=(0 0) 00010000:00010000:1.0:1787779762.959975:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787779762.959979:0:14993:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054db027d/0x9e63ba8af688a12d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779762.959989:0:14993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054db027d/0x9e63ba8af688a12d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779762.959997:0:14993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054db027d/0x9e63ba8af688a12d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779762.960004:0:14993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054db027d/0x9e63ba8af688a12d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779762.960026:0:14993:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787779762.960337:0:14993:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787779762.960344:0:14993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c48a6216/0x9e63ba8af688a134 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779762.960353:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=528s v=(0 0) 00010000:00010000:1.0:1787779762.960356:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787779762.960361:0:14993:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c48a6216/0x9e63ba8af688a134 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779762.960371:0:14993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c48a6216/0x9e63ba8af688a134 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779762.960380:0:14297:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787779762.960380:0:14993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c48a6216/0x9e63ba8af688a134 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779762.960391:0:14297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000030ec1cf7/0x9e63ba8af688a126 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779762.960393:0:14993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c48a6216/0x9e63ba8af688a134 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779762.960409:0:14993:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787779762.960418:0:14297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87a98a800 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:3.0:1787779762.960424:0:14297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000030ec1cf7/0x9e63ba8af688a126 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779762.960434:0:14297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000030ec1cf7/0x9e63ba8af688a126 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779762.960465:0:14297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000030ec1cf7/0x9e63ba8af688a126 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779762.960475:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030ec1cf7/0x9e63ba8af688a126 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779762.960498:0:14297:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787779762.960502:0:14297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054db027d/0x9e63ba8af688a12d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779762.960509:0:14297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87a98aa00 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:3.0:1787779762.960513:0:14297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054db027d/0x9e63ba8af688a12d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779762.960533:0:14297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054db027d/0x9e63ba8af688a12d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779762.960546:0:14297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054db027d/0x9e63ba8af688a12d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779762.960554:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054db027d/0x9e63ba8af688a12d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779762.960570:0:14297:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787779762.960583:0:14297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c48a6216/0x9e63ba8af688a134 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779762.960590:0:14297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87a98a600 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:3.0:1787779762.960594:0:14297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c48a6216/0x9e63ba8af688a134 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779762.960603:0:14297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c48a6216/0x9e63ba8af688a134 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779762.960615:0:14297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c48a6216/0x9e63ba8af688a134 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779762.960622:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c48a6216/0x9e63ba8af688a134 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779762.960646:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787779762.960647:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787779762.960649:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787779762.960799:0:14993:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787779762.960804:0:14993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c1ca1ae/0x9e63ba8af688a13b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779762.960812:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=528s v=(0 0) 00010000:00010000:1.0:1787779762.960819:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787779762.960823:0:14993:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c1ca1ae/0x9e63ba8af688a13b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779762.960833:0:14993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c1ca1ae/0x9e63ba8af688a13b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779762.960840:0:14993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c1ca1ae/0x9e63ba8af688a13b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779762.960849:0:14993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005c1ca1ae/0x9e63ba8af688a13b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779762.960862:0:14993:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787779762.961100:0:14297:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787779762.961106:0:14297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005c1ca1ae/0x9e63ba8af688a13b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779762.961114:0:14297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87a98ae00 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:3.0:1787779762.961129:0:14297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005c1ca1ae/0x9e63ba8af688a13b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779762.961139:0:14297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005c1ca1ae/0x9e63ba8af688a13b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779762.961152:0:14297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005c1ca1ae/0x9e63ba8af688a13b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779762.961160:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c1ca1ae/0x9e63ba8af688a13b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779762.961179:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787779762.961181:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787779762.961183:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787779762.961206:0:14993:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787779762.961212:0:14993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1b677ba/0x9e63ba8af688a142 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779762.961219:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=528s v=(0 0) 00010000:00010000:1.0:1787779762.961222:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787779762.961227:0:14993:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a1b677ba/0x9e63ba8af688a142 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779762.961236:0:14993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a1b677ba/0x9e63ba8af688a142 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779762.961243:0:14993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1b677ba/0x9e63ba8af688a142 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779762.961439:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779762.968091:0:14993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a1b677ba/0x9e63ba8af688a142 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779762.968116:0:14993:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787779762.970303:0:14993:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787779762.970314:0:14993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000807640ef/0x9e63ba8af688a149 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779762.970330:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=528s v=(0 0) 00010000:00010000:1.0:1787779762.970334:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787779762.970341:0:14993:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000807640ef/0x9e63ba8af688a149 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779762.970356:0:14993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000807640ef/0x9e63ba8af688a149 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779762.970366:0:14993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000807640ef/0x9e63ba8af688a149 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779762.970374:0:14993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000807640ef/0x9e63ba8af688a149 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779762.970407:0:14993:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787779762.970500:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787779762.970509:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a1b677ba/0x9e63ba8af688a142 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779762.970519:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87a98b800 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:2.0:1787779762.970525:0:14298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1b677ba/0x9e63ba8af688a142 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779762.970536:0:14298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1b677ba/0x9e63ba8af688a142 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779762.970556:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a1b677ba/0x9e63ba8af688a142 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779762.970564:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a1b677ba/0x9e63ba8af688a142 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779762.970657:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787779762.970661:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000807640ef/0x9e63ba8af688a149 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779762.970669:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87a98a400 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:2.0:1787779762.970673:0:14298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000807640ef/0x9e63ba8af688a149 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779762.970681:0:14298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000807640ef/0x9e63ba8af688a149 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779762.970693:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000807640ef/0x9e63ba8af688a149 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779762.970701:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000807640ef/0x9e63ba8af688a149 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779762.970739:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779762.970743:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779762.970745:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779762.970849:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787779762.972757:0:14993:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787779762.972769:0:14993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002bec7a02/0x9e63ba8af688a150 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779762.972788:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=528s v=(0 0) 00010000:00010000:1.0:1787779762.972792:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787779762.972798:0:14993:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002bec7a02/0x9e63ba8af688a150 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779762.972810:0:14993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002bec7a02/0x9e63ba8af688a150 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779762.972820:0:14993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002bec7a02/0x9e63ba8af688a150 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779762.972828:0:14993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002bec7a02/0x9e63ba8af688a150 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779762.972891:0:14993:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787779762.973291:0:14993:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787779762.973297:0:14993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f80e8039/0x9e63ba8af688a157 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779762.973306:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=528s v=(0 0) 00010000:00010000:1.0:1787779762.973308:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787779762.973312:0:14993:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f80e8039/0x9e63ba8af688a157 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779762.973322:0:14993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f80e8039/0x9e63ba8af688a157 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779762.973339:0:14993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f80e8039/0x9e63ba8af688a157 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779762.973347:0:14993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f80e8039/0x9e63ba8af688a157 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779762.980270:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787779762.980285:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002bec7a02/0x9e63ba8af688a150 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779762.980316:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87a94ec00 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:0.0:1787779762.980320:0:14298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002bec7a02/0x9e63ba8af688a150 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779762.980332:0:14298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002bec7a02/0x9e63ba8af688a150 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779762.980355:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002bec7a02/0x9e63ba8af688a150 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779762.980363:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002bec7a02/0x9e63ba8af688a150 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779762.980384:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787779762.980388:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f80e8039/0x9e63ba8af688a157 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779762.980395:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87a94e000 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:0.0:1787779762.980398:0:14298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f80e8039/0x9e63ba8af688a157 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779762.980405:0:14298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f80e8039/0x9e63ba8af688a157 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779762.980416:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f80e8039/0x9e63ba8af688a157 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779762.980439:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779762.980441:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779762.980443:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779762.981876:0:14993:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787779762.981891:0:14993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f80e8039/0x9e63ba8af688a157 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779762.982092:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787779762.983383:0:14993:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787779762.983392:0:14993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7e84f93/0x9e63ba8af688a15e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779762.983407:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=528s v=(0 0) 00010000:00010000:1.0:1787779762.983411:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787779762.983417:0:14993:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7e84f93/0x9e63ba8af688a15e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779762.983900:0:14993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7e84f93/0x9e63ba8af688a15e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779762.983913:0:14993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7e84f93/0x9e63ba8af688a15e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779762.983933:0:14993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c7e84f93/0x9e63ba8af688a15e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779762.983981:0:14993:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787779762.984955:0:14993:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787779762.984963:0:14993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3688a86/0x9e63ba8af688a165 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779762.984975:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=528s v=(0 0) 00010000:00010000:1.0:1787779762.984979:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787779762.984984:0:14993:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3688a86/0x9e63ba8af688a165 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779762.984994:0:14993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3688a86/0x9e63ba8af688a165 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779762.985003:0:14993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3688a86/0x9e63ba8af688a165 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779762.985011:0:14993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3688a86/0x9e63ba8af688a165 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779762.988036:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787779762.988053:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c7e84f93/0x9e63ba8af688a15e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779762.988068:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87a94f800 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:0.0:1787779762.988073:0:14298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7e84f93/0x9e63ba8af688a15e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779762.988084:0:14298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7e84f93/0x9e63ba8af688a15e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779762.988106:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c7e84f93/0x9e63ba8af688a15e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779762.988115:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7e84f93/0x9e63ba8af688a15e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779762.988163:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787779762.988168:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3688a86/0x9e63ba8af688a165 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779762.988175:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87a94e200 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:0.0:1787779762.988193:0:14298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3688a86/0x9e63ba8af688a165 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779762.988203:0:14298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3688a86/0x9e63ba8af688a165 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779762.988214:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3688a86/0x9e63ba8af688a165 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779762.988224:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779762.988226:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779762.988229:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779762.990676:0:14993:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787779762.990691:0:14993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3688a86/0x9e63ba8af688a165 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779762.990770:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787779762.995145:0:14993:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787779762.995159:0:14993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f0ac6f2/0x9e63ba8af688a16c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779762.995178:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=528s v=(0 0) 00010000:00010000:1.0:1787779762.995183:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787779762.995189:0:14993:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f0ac6f2/0x9e63ba8af688a16c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779762.995203:0:14993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f0ac6f2/0x9e63ba8af688a16c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779762.995213:0:14993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f0ac6f2/0x9e63ba8af688a16c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779762.995222:0:14993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009f0ac6f2/0x9e63ba8af688a16c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779762.995240:0:14993:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787779762.995261:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787779762.995266:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009f0ac6f2/0x9e63ba8af688a16c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779762.995274:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87a94e400 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:1.0:1787779762.995288:0:14298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009f0ac6f2/0x9e63ba8af688a16c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779762.995298:0:14298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009f0ac6f2/0x9e63ba8af688a16c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779762.995313:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009f0ac6f2/0x9e63ba8af688a16c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779762.995321:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f0ac6f2/0x9e63ba8af688a16c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779762.995339:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779762.995341:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779762.995342:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787779762.995853:0:14993:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787779762.995859:0:14993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e59267e/0x9e63ba8af688a173 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779762.995868:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=528s v=(0 0) 00010000:00010000:1.0:1787779762.995871:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787779762.995876:0:14993:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e59267e/0x9e63ba8af688a173 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779762.995885:0:14993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e59267e/0x9e63ba8af688a173 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779762.995893:0:14993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e59267e/0x9e63ba8af688a173 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779762.995906:0:14993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002e59267e/0x9e63ba8af688a173 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779762.995920:0:14993:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787779762.995928:0:14297:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787779762.995933:0:14297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002e59267e/0x9e63ba8af688a173 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779762.995940:0:14297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87a94f200 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:1.0:1787779762.995944:0:14297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002e59267e/0x9e63ba8af688a173 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779762.995952:0:14297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002e59267e/0x9e63ba8af688a173 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779762.995962:0:14297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002e59267e/0x9e63ba8af688a173 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779762.995970:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e59267e/0x9e63ba8af688a173 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779762.995982:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779762.995983:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779762.995985:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787779763.002856:0:14993:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787779763.002880:0:14993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8a72abe/0x9e63ba8af688a17a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779763.002897:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=528s v=(0 0) 00010000:00010000:1.0:1787779763.002902:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787779763.002908:0:14993:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8a72abe/0x9e63ba8af688a17a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779763.002922:0:14993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8a72abe/0x9e63ba8af688a17a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779763.002933:0:14993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8a72abe/0x9e63ba8af688a17a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779763.002941:0:14993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8a72abe/0x9e63ba8af688a17a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779763.002963:0:14993:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787779763.003230:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787779763.003238:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8a72abe/0x9e63ba8af688a17a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779763.003246:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87a94ee00 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:2.0:1787779763.003256:0:14298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8a72abe/0x9e63ba8af688a17a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779763.003266:0:14298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8a72abe/0x9e63ba8af688a17a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779763.003284:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8a72abe/0x9e63ba8af688a17a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779763.003292:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8a72abe/0x9e63ba8af688a17a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779763.003310:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779763.003312:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779763.003314:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787779763.006438:0:14993:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787779763.006515:0:14993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057f356ca/0x9e63ba8af688a181 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779763.006531:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=528s v=(0 0) 00010000:00010000:1.0:1787779763.006535:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787779763.006542:0:14993:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000057f356ca/0x9e63ba8af688a181 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779763.006557:0:14993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000057f356ca/0x9e63ba8af688a181 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779763.006573:0:14993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057f356ca/0x9e63ba8af688a181 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779763.006581:0:14993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000057f356ca/0x9e63ba8af688a181 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779763.006644:0:14993:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787779763.007094:0:14993:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787779763.007100:0:14993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002996991a/0x9e63ba8af688a188 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779763.007109:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=528s v=(0 0) 00010000:00010000:1.0:1787779763.007112:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787779763.007115:0:14993:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002996991a/0x9e63ba8af688a188 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779763.007125:0:14993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002996991a/0x9e63ba8af688a188 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779763.007132:0:14993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002996991a/0x9e63ba8af688a188 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779763.007140:0:14993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002996991a/0x9e63ba8af688a188 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779763.011841:0:14297:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787779763.011857:0:14297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000057f356ca/0x9e63ba8af688a181 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779763.011872:0:14297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87a94f600 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:2.0:1787779763.011877:0:14297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000057f356ca/0x9e63ba8af688a181 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779763.011888:0:14297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000057f356ca/0x9e63ba8af688a181 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779763.011910:0:14297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000057f356ca/0x9e63ba8af688a181 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779763.011932:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000057f356ca/0x9e63ba8af688a181 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779763.012057:0:14297:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787779763.012062:0:14297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002996991a/0x9e63ba8af688a188 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779763.012069:0:14297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87a94e800 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:2.0:1787779763.012073:0:14297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002996991a/0x9e63ba8af688a188 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779763.012082:0:14297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002996991a/0x9e63ba8af688a188 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779763.012093:0:14297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002996991a/0x9e63ba8af688a188 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779763.012100:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779763.012102:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779763.012104:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779763.012241:0:14993:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787779763.012257:0:14993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002996991a/0x9e63ba8af688a188 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779763.013478:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787779763.015593:0:14993:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787779763.015603:0:14993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb869d27/0x9e63ba8af688a18f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779763.015619:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=528s v=(0 0) 00010000:00010000:1.0:1787779763.015623:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787779763.015629:0:14993:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb869d27/0x9e63ba8af688a18f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779763.015643:0:14993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb869d27/0x9e63ba8af688a18f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779763.015653:0:14993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb869d27/0x9e63ba8af688a18f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779763.015662:0:14993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb869d27/0x9e63ba8af688a18f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779763.015776:0:14993:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787779763.016196:0:14993:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787779763.016202:0:14993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001933b497/0x9e63ba8af688a196 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779763.016216:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=528s v=(0 0) 00010000:00010000:1.0:1787779763.016219:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787779763.016223:0:14993:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001933b497/0x9e63ba8af688a196 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779763.016233:0:14993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001933b497/0x9e63ba8af688a196 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779763.016241:0:14993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001933b497/0x9e63ba8af688a196 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779763.016496:0:14993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001933b497/0x9e63ba8af688a196 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779763.023586:0:14297:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787779763.023608:0:14297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb869d27/0x9e63ba8af688a18f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779763.023623:0:14297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87a94fe00 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:2.0:1787779763.023659:0:14297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb869d27/0x9e63ba8af688a18f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779763.023672:0:14297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb869d27/0x9e63ba8af688a18f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779763.023696:0:14297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb869d27/0x9e63ba8af688a18f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779763.023704:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb869d27/0x9e63ba8af688a18f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779763.024423:0:14297:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787779763.024439:0:14297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001933b497/0x9e63ba8af688a196 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779763.024457:0:14297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87a94ea00 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:2.0:1787779763.024461:0:14297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001933b497/0x9e63ba8af688a196 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779763.024469:0:14297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001933b497/0x9e63ba8af688a196 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779763.024481:0:14297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001933b497/0x9e63ba8af688a196 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779763.024489:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779763.024498:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779763.024500:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779763.027522:0:14993:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787779763.027538:0:14993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001933b497/0x9e63ba8af688a196 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787779763.028174:0:14993:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787779763.028181:0:14993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3688a86/0x9e63ba8af688a19d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779763.028195:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=528s v=(0 0) 00010000:00010000:1.0:1787779763.028199:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787779763.028206:0:14993:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3688a86/0x9e63ba8af688a19d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779763.028232:0:14993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3688a86/0x9e63ba8af688a19d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779763.028242:0:14993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3688a86/0x9e63ba8af688a19d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779763.028261:0:14993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3688a86/0x9e63ba8af688a19d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779763.028285:0:14993:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787779763.028537:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787779763.028545:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3688a86/0x9e63ba8af688a19d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779763.028554:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87a94e200 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:2.0:1787779763.028558:0:14298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3688a86/0x9e63ba8af688a19d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779763.028567:0:14298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3688a86/0x9e63ba8af688a19d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779763.028583:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3688a86/0x9e63ba8af688a19d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779763.028590:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3688a86/0x9e63ba8af688a19d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779763.028606:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779763.028608:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779763.028610:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787779763.028656:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787779763.029230:0:14993:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787779763.029237:0:14993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f80e8039/0x9e63ba8af688a1a4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787779763.032519:0:5857:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:1.0:1787779763.036627:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=528s v=(0 0) 00010000:00010000:1.0:1787779763.036639:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787779763.036650:0:14993:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f80e8039/0x9e63ba8af688a1a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779763.036671:0:14993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f80e8039/0x9e63ba8af688a1a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779763.036684:0:14993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f80e8039/0x9e63ba8af688a1a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779763.036729:0:14993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f80e8039/0x9e63ba8af688a1a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779763.036755:0:14993:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787779763.037724:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787779763.037735:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f80e8039/0x9e63ba8af688a1a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779763.037746:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87a94e000 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:2.0:1787779763.037751:0:14298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f80e8039/0x9e63ba8af688a1a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779763.037771:0:14298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f80e8039/0x9e63ba8af688a1a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779763.037791:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f80e8039/0x9e63ba8af688a1a4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779763.037810:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f80e8039/0x9e63ba8af688a1a4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779763.037833:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779763.037835:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779763.037837:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787779763.038318:0:14993:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787779763.038326:0:14993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001492b479/0x9e63ba8af688a1ab lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779763.038343:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=528s v=(0 0) 00010000:00010000:3.0:1787779763.038346:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787779763.038352:0:14993:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001492b479/0x9e63ba8af688a1ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779763.038363:0:14993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001492b479/0x9e63ba8af688a1ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779763.038372:0:14993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001492b479/0x9e63ba8af688a1ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779763.038380:0:14993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001492b479/0x9e63ba8af688a1ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779763.038404:0:14993:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787779763.038542:0:14297:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787779763.038549:0:14297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001492b479/0x9e63ba8af688a1ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779763.038558:0:14297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e8429d4e00 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:2.0:1787779763.038563:0:14297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001492b479/0x9e63ba8af688a1ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779763.038580:0:14297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001492b479/0x9e63ba8af688a1ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779763.038595:0:14297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001492b479/0x9e63ba8af688a1ab lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779763.038615:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001492b479/0x9e63ba8af688a1ab lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779763.038634:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779763.038635:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779763.038637:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787779763.039380:0:14993:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787779763.039388:0:14993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe95f165/0x9e63ba8af688a1b2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779763.039416:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=528s v=(0 0) 00010000:00010000:2.0:1787779763.039420:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787779763.039425:0:14993:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe95f165/0x9e63ba8af688a1b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779763.039436:0:14993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe95f165/0x9e63ba8af688a1b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779763.039445:0:14993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe95f165/0x9e63ba8af688a1b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779763.039462:0:14993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fe95f165/0x9e63ba8af688a1b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779763.039484:0:14993:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787779763.040142:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787779763.040150:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fe95f165/0x9e63ba8af688a1b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779763.040159:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87aa66a00 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:1.0:1787779763.040165:0:14298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe95f165/0x9e63ba8af688a1b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779763.040174:0:14298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe95f165/0x9e63ba8af688a1b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779763.040188:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fe95f165/0x9e63ba8af688a1b2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779763.040196:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe95f165/0x9e63ba8af688a1b2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779763.040212:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779763.040214:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779763.040216:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787779763.040817:0:14993:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787779763.040830:0:14993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e4937c8/0x9e63ba8af688a1b9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779763.040841:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=528s v=(0 0) 00010000:00010000:2.0:1787779763.040844:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787779763.040849:0:14993:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e4937c8/0x9e63ba8af688a1b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779763.040860:0:14993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e4937c8/0x9e63ba8af688a1b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779763.040869:0:14993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e4937c8/0x9e63ba8af688a1b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779763.040877:0:14993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002e4937c8/0x9e63ba8af688a1b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779763.040900:0:14993:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787779763.041323:0:14297:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787779763.041329:0:14297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002e4937c8/0x9e63ba8af688a1b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779763.041338:0:14297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87aa66400 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:3.0:1787779763.041342:0:14297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002e4937c8/0x9e63ba8af688a1b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779763.041350:0:14297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002e4937c8/0x9e63ba8af688a1b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779763.041375:0:14297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002e4937c8/0x9e63ba8af688a1b9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779763.041382:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e4937c8/0x9e63ba8af688a1b9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779763.041417:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787779763.041419:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787779763.041421:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787779763.042322:0:14993:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787779763.042331:0:14993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c23f9aa/0x9e63ba8af688a1c0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779763.042342:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=528s v=(0 0) 00010000:00010000:2.0:1787779763.042345:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787779763.042351:0:14993:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c23f9aa/0x9e63ba8af688a1c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779763.042361:0:14993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c23f9aa/0x9e63ba8af688a1c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779763.042377:0:14993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c23f9aa/0x9e63ba8af688a1c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779763.042384:0:14993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007c23f9aa/0x9e63ba8af688a1c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779763.042528:0:14993:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787779763.043225:0:14993:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787779763.043232:0:14993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c4c5017/0x9e63ba8af688a1c7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779763.043244:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=528s v=(0 0) 00010000:00010000:2.0:1787779763.043246:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787779763.043251:0:14993:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c4c5017/0x9e63ba8af688a1c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779763.043261:0:14993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c4c5017/0x9e63ba8af688a1c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779763.043270:0:14993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c4c5017/0x9e63ba8af688a1c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779763.043278:0:14993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000c4c5017/0x9e63ba8af688a1c7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779763.043346:0:14993:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1787779763.044336:0:14993:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787779763.044344:0:14993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003051ae0b/0x9e63ba8af688a1ce lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779763.044355:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=528s v=(0 0) 00010000:00010000:2.0:1787779763.044358:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787779763.044363:0:14993:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003051ae0b/0x9e63ba8af688a1ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779763.044373:0:14993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003051ae0b/0x9e63ba8af688a1ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779763.044382:0:14993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003051ae0b/0x9e63ba8af688a1ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779763.044389:0:14993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003051ae0b/0x9e63ba8af688a1ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779763.044754:0:14297:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787779763.044763:0:14297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007c23f9aa/0x9e63ba8af688a1c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779763.044772:0:14297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87aa67c00 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:3.0:1787779763.044777:0:14297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007c23f9aa/0x9e63ba8af688a1c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779763.044786:0:14297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007c23f9aa/0x9e63ba8af688a1c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779763.044811:0:14297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007c23f9aa/0x9e63ba8af688a1c0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779763.044819:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c23f9aa/0x9e63ba8af688a1c0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779763.044849:0:14297:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787779763.044853:0:14297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000c4c5017/0x9e63ba8af688a1c7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779763.044859:0:14297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87aa66e00 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:3.0:1787779763.044862:0:14297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000c4c5017/0x9e63ba8af688a1c7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779763.044871:0:14297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000c4c5017/0x9e63ba8af688a1c7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779763.044879:0:14297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000c4c5017/0x9e63ba8af688a1c7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779763.044886:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c4c5017/0x9e63ba8af688a1c7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779763.044898:0:14297:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787779763.044901:0:14297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003051ae0b/0x9e63ba8af688a1ce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779763.044908:0:14297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87aa66000 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:3.0:1787779763.044910:0:14297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003051ae0b/0x9e63ba8af688a1ce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779763.044927:0:14297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003051ae0b/0x9e63ba8af688a1ce lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779763.044948:0:14297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003051ae0b/0x9e63ba8af688a1ce lrc: 2/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779763.044956:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787779763.044958:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787779763.044960:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779763.050323:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779763.053745:0:14993:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787779763.053766:0:14993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003051ae0b/0x9e63ba8af688a1ce lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787779763.055242:0:14993:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787779763.055252:0:14993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c9cc080/0x9e63ba8af688a1d5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779763.055273:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=528s v=(0 0) 00010000:00010000:2.0:1787779763.055278:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787779763.055284:0:14993:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c9cc080/0x9e63ba8af688a1d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779763.055298:0:14993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c9cc080/0x9e63ba8af688a1d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779763.055308:0:14993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c9cc080/0x9e63ba8af688a1d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779763.055317:0:14993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c9cc080/0x9e63ba8af688a1d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779763.055719:0:14297:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787779763.055729:0:14297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c9cc080/0x9e63ba8af688a1d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779763.055738:0:14297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87aa66c00 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:3.0:1787779763.055744:0:14297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c9cc080/0x9e63ba8af688a1d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779763.055753:0:14297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c9cc080/0x9e63ba8af688a1d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779763.055771:0:14297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c9cc080/0x9e63ba8af688a1d5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779763.055781:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787779763.055782:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787779763.055784:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779763.056210:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779763.056214:0:14993:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787779763.056223:0:14993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c9cc080/0x9e63ba8af688a1d5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787779763.057216:0:14993:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787779763.057225:0:14993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c416203/0x9e63ba8af688a1dc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779763.057237:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=528s v=(0 0) 00010000:00010000:2.0:1787779763.057241:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787779763.057247:0:14993:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c416203/0x9e63ba8af688a1dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779763.057269:0:14993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c416203/0x9e63ba8af688a1dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779763.057279:0:14993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c416203/0x9e63ba8af688a1dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779763.057286:0:14993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c416203/0x9e63ba8af688a1dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779763.057304:0:14993:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787779763.057667:0:14297:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787779763.057674:0:14297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c416203/0x9e63ba8af688a1dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779763.057682:0:14297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87aa66200 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:3.0:1787779763.057687:0:14297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c416203/0x9e63ba8af688a1dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779763.057696:0:14297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c416203/0x9e63ba8af688a1dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779763.057721:0:14297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c416203/0x9e63ba8af688a1dc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779763.057729:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c416203/0x9e63ba8af688a1dc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779763.057747:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787779763.057748:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787779763.057751:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1787779763.057856:0:14993:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:2.0:1787779763.058196:0:14993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e852b9d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14332:x1874622525050496:12345-0@lo:5:osp-pre-0-0.0 Request processed in 113045us (113183us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779763.058209:0:14993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787779763.059175:0:14332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e852b9e580 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14332:1874622525050496:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1787779763.059193:0:14332:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:1.0:1787779763.059239:0:14332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e852b9e580 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14332:1874622525050624:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1787779763.059286:0:14332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779763.059499:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525050624 00000100:00100000:3.0:1787779763.059506:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525050624 00000100:00100000:3.0:1787779763.059558:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787779763.059566:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e852b9de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14332:x1874622525050624:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1787779763.059669:0:14991:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:1.0:1787779763.060214:0:14332:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e845d959c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787779763.082366:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e852b9de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14332:x1874622525050624:12345-0@lo:5:osp-pre-0-0.0 Request processed in 22791us (23070us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1787779763.082387:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787779763.082460:0:14332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e852b9e580 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14332:1874622525050624:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1787779763.082477:0:14332:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:3.0:1787779763.699664:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787779764.723667:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787779765.754326:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787779766.616376:0:15708:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787779766.616381:0:15708:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1787779766.619245:0:15708:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff98e873adf000 00000020:01000004:2.0:1787779766.619267:0:15708:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1787779766.619281:0:15708:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1787779766.619318:0:15708:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff98e74121cd28) 00000020:00000080:2.0:1787779766.619335:0:15708:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787779766.655072:0:15708:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787779766.655347:0:15708:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1787779766.656801:0:15708:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787779766.657108:0:15708:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1787779766.657299:0:15708:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1787779766.657678:0:15708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 525: rc = 0 00100000:10000000:2.0:1787779766.658037:0:15708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 525: rc = 0 00100000:10000000:2.0:1787779766.658122:0:15708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 525: rc = 0 00100000:10000000:2.0:1787779766.659523:0:15708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 624: rc = 0 00100000:10000000:2.0:1787779766.660122:0:15708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 624: rc = 0 00100000:10000000:2.0:1787779766.660359:0:15708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 624: rc = 0 00100000:10000000:2.0:1787779766.660608:0:15708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 624: rc = 0 00100000:10000000:2.0:1787779766.660862:0:15708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 624: rc = 0 00100000:10000000:2.0:1787779766.661310:0:15708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 624: rc = 0 00000020:00000080:2.0:1787779766.662242:0:15708:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1787779766.662256:0:15708:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787779766.662266:0:15708:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9e63ba8af688a1ea 00000020:01000004:2.0:1787779766.662275:0:15708:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1787779766.662294:0:15708:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.109@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787779766.662297:0:15708:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.109@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787779766.662303:0:15708:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1787779766.662322:0:15708:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1787779766.662326:0:15708:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.109@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1787779766.671546:0:15708:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.109@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787779766.671588:0:15708:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.109@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1787779766.671592:0:15708:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787779766.671594:0:15708:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787779766.671596:0:15708:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787779766.671597:0:15708:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787779766.671598:0:15708:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787779766.671600:0:15708:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787779766.671601:0:15708:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787779766.671603:0:15708:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787779766.671604:0:15708:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787779766.671608:0:15708:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1787779766.671610:0:15708:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787779766.671611:0:15708:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787779766.671616:0:15708:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787779766.671617:0:15708:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787779766.671618:0:15708:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787779766.671619:0:15708:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787779766.671620:0:15708:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787779766.671621:0:15708:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787779766.671622:0:15708:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787779766.671647:0:15708:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787779766.671666:0:15708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e741e6f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:15708:1874622525050752:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787779766.671762:0:15708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779766.672024:0:15708:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e87f196f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787779766.672065:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525050752 00000100:00100000:3.0:1787779766.672072:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525050752 00000100:00100000:3.0:1787779766.672174:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787779766.672184:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e84517f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+16:15708:x1874622525050752:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787779766.672223:0:14301:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1787779766.672226:0:14301:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1787779766.672229:0:14301:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1787779766.683670:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e84517f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+16:15708:x1874622525050752:12345-0@lo:253:mount.lustre.0 Request processed in 11470us (11891us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779766.683698:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787779766.683700:0:15708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e741e6f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:15708:1874622525050752:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787779766.683761:0:15708:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787779766.683765:0:15708:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787779766.683767:0:15708:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787779766.683769:0:15708:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787779766.683771:0:15708:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787779766.683773:0:15708:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787779766.683774:0:15708:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787779766.683776:0:15708:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787779766.683778:0:15708:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787779766.683780:0:15708:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787779766.683805:0:15708:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98e873adf000 from lustre-OST0001 10000000:01000000:2.0:1787779766.683833:0:15708:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1787779766.683836:0:15708:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787779766.683844:0:15708:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff98e87f03b370 local copy 00010000:00010000:2.0:1787779766.683854:0:15708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e87a98b200/0x9e63ba8af6889f97 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6889f9e expref: -99 pid: 14291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779766.684476:0:15708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e7435061c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:15708:1874622525050880:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787779766.684534:0:15708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779766.684587:0:15708:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e844dd5f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787779766.684781:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525050880 00000100:00100000:0.0:1787779766.684790:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525050880 00000100:00100000:0.0:1787779766.684855:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787779766.684866:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e84517c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+16:15708:x1874622525050880:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787779766.685311:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e84517c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+16:15708:x1874622525050880:12345-0@lo:501:mount.lustre.0 Request processed in 446us (776us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787779766.685321:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787779766.685401:0:15708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e7435061c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:15708:1874622525050880:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787779766.685425:0:15708:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.109@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787779766.685662:0:15708:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.109@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787779766.685671:0:15708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e87a98b200/0x9e63ba8af6889f97 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6889f9e expref: -99 pid: 14291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779766.685688:0:15708:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff98e87a98b200/0x9e63ba8af6889f97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af6889f9e expref: -99 pid: 14291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787779766.685752:0:15708:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98e873adf000 10000000:01000000:2.0:1787779766.685757:0:15708:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787779766.685763:0:15708:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787779766.685765:0:15708:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787779766.685770:0:15708:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1787779766.685772:0:15708:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787779766.685810:0:15708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e87aa66400/0x9e63ba8af688a1f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779766.685820:0:15708:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff98e87aa66400/0x9e63ba8af688a1f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779766.685831:0:15708:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff98e87aa66400/0x9e63ba8af688a1f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779766.685852:0:15708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e741e6f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:15708:1874622525051008:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787779766.685931:0:15708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779766.685973:0:15708:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e87f196480 going to sleep for 11 seconds 00000100:00100000:0.0:1787779766.687201:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525051008 00000100:00100000:0.0:1787779766.687233:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525051008 00000100:00100000:0.0:1787779766.687309:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787779766.687320:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e84517c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+16:15708:x1874622525051008:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787779766.687342:0:14301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787779766.687366:0:14301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e848f69400/0x9e63ba8af688a1f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9e63ba8af688a1f1 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779766.687544:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e848f69400/0x9e63ba8af688a1f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9e63ba8af688a1f1 expref: 17 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779766.687559:0:14301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e848f69400/0x9e63ba8af688a1f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af688a1f1 expref: 17 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779766.687571:0:14301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e848f69400, rc 0) 00000100:00100000:2.0:1787779766.687860:0:15708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e741e6f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:15708:1874622525051008:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787779766.687896:0:15708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff98e87aa66400/0x9e63ba8af688a1f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af688a1f8 expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779766.687910:0:15708:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff98e87aa66400/0x9e63ba8af688a1f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9e63ba8af688a1f8 expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779766.688168:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e84517c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+17:15708:x1874622525051008:12345-0@lo:101:mount.lustre.0 Request processed in 847us (2233us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779766.688179:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000040:00080000:2.0:1787779766.689215:0:15708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1787779766.691691:0:15708:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787779766.692688:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1787779766.692904:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1787779766.692941:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1787779766.692986:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1787779766.693227:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1787779766.693262:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1787779766.693557:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1787779766.693567:0:15708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1787779766.693993:0:15708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87fdd30c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:15708:1874622525051136:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787779766.694561:0:15708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779766.694706:0:15708:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e848f40d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787779766.700785:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525051136 00000100:00100000:3.0:1787779766.700958:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525051136 00000100:00100000:3.0:1787779766.701255:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787779766.701270:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e84517e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+17:15708:x1874622525051136:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787779766.701955:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e84517e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+17:15708:x1874622525051136:12345-0@lo:501:mount.lustre.0 Request processed in 688us (7394us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779766.701965:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787779766.702069:0:15708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87fdd30c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:15708:1874622525051136:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787779766.702136:0:15708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e741e6f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:15708:1874622525051264:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787779766.702214:0:15708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779766.702267:0:15708:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e87f196480 going to sleep for 11 seconds 00000100:00100000:3.0:1787779766.702885:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525051264 00000100:00100000:3.0:1787779766.702895:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525051264 00000100:00100000:3.0:1787779766.702955:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787779766.702963:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e84517ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+17:15708:x1874622525051264:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787779766.704688:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e84517ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+17:15708:x1874622525051264:12345-0@lo:503:mount.lustre.0 Request processed in 1714us (2463us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779766.704704:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787779766.707889:0:15708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e741e6f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:15708:1874622525051264:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787779766.709022:0:15708:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787779766.709134:0:15708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87fdd3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:15708:1874622525051392:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787779766.709245:0:15708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779766.709294:0:15708:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e848f40e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787779766.709592:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525051392 00000100:00100000:3.0:1787779766.709602:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525051392 00000100:00100000:3.0:1787779766.709665:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787779766.709675:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e84517d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+17:15708:x1874622525051392:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787779766.709984:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e84517d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+17:15708:x1874622525051392:12345-0@lo:502:mount.lustre.0 Request processed in 310us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779766.709993:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787779766.710581:0:15708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87fdd3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:15708:1874622525051392:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787779766.710903:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1787779766.710960:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1787779766.710992:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1787779766.712768:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1787779766.712836:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1787779766.712878:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1787779766.712945:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1787779766.712987:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1787779766.713193:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1787779766.713260:0:15708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87fdd3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:15708:1874622525051520:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787779766.713374:0:15708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779766.713614:0:15708:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e848f40e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787779766.713619:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525051520 00000100:00100000:3.0:1787779766.713628:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525051520 00000100:00100000:3.0:1787779766.713749:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787779766.713761:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e84517e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+17:15708:x1874622525051520:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787779766.714023:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e84517e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+17:15708:x1874622525051520:12345-0@lo:502:mount.lustre.0 Request processed in 263us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779766.714031:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787779766.714131:0:15708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87fdd3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:15708:1874622525051520:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787779766.714215:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1787779766.714228:0:15708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:2.0:1787779766.716195:0:15709:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787779766.716210:0:15709:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1787779766.716218:0:15709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787779766.716221:0:15709:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1787779766.716227:0:15709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787779766.716246:0:15709:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff98e741218000) 00000020:00000080:2.0:1787779766.716276:0:15709:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787779766.716286:0:15709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787779766.716524:0:15709:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98e873adf000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1787779766.716534:0:15709:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787779766.716544:0:15709:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9e63ba8af688a206 00010000:00010000:2.0:1787779766.729318:0:15709:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:2.0:1787779766.730605:0:15709:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:2.0:1787779766.738005:0:15709:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1787779766.748608:0:15709:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1787779766.748632:0:15709:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787779766.748640:0:15709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787779766.748643:0:15709:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1787779766.748646:0:15709:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787779766.748652:0:15709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787779766.748653:0:15709:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787779766.748656:0:15709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787779766.748659:0:15709:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787779766.748662:0:15709:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787779766.748673:0:15709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787779766.748675:0:15709:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787779766.748678:0:15709:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787779766.748680:0:15709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787779766.748682:0:15709:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787779766.748685:0:15709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1787779766.748786:0:15709:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787779766.748790:0:15709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787779766.748791:0:15709:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787779766.750150:0:15709:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:1.0:1787779766.750546:0:15708:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1787779766.750582:0:15708:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787779766.750614:0:15708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e87aa66400/0x9e63ba8af688a1f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af688a1f8 expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779766.750637:0:15708:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff98e87aa66400/0x9e63ba8af688a1f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af688a1f8 expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787779766.750646:0:15708:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98e873adf000 from 1 10000000:01000000:1.0:1787779766.750650:0:15708:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787779766.750699:0:15708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e87a94f000/0x9e63ba8af688a20d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779766.750738:0:15708:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff98e87a94f000/0x9e63ba8af688a20d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779766.750753:0:15708:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff98e87a94f000/0x9e63ba8af688a20d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779766.750810:0:15708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e852b9c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:15708:1874622525051648:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787779766.750900:0:15708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779766.750954:0:15708:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e8496d4240 going to sleep for 11 seconds 00000100:00100000:3.0:1787779766.751254:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525051648 00000100:00100000:3.0:1787779766.751263:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525051648 00000100:00100000:3.0:1787779766.751324:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787779766.751343:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e84517d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+17:15708:x1874622525051648:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787779766.751362:0:14304:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779766.751393:0:14304:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e8429d4200/0x9e63ba8af688a214 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9e63ba8af688a20d expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779766.751424:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e8429d4200/0x9e63ba8af688a214 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9e63ba8af688a20d expref: 18 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779766.751437:0:14304:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e8429d4200/0x9e63ba8af688a214 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af688a20d expref: 18 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779766.751448:0:14304:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e8429d4200, rc 0) 00000100:00100000:3.0:1787779766.751496:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e84517d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+18:15708:x1874622525051648:12345-0@lo:101:mount.lustre.0 Request processed in 156us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779766.751514:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787779766.752686:0:15708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e852b9c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:15708:1874622525051648:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787779766.752740:0:15708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff98e87a94f000/0x9e63ba8af688a20d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af688a214 expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779766.752761:0:15708:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff98e87a94f000/0x9e63ba8af688a20d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9e63ba8af688a214 expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787779766.755545:0:15708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1787779766.762845:0:15708:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787779766.763232:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1787779766.763279:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1787779766.763338:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1787779766.763346:0:15708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1787779766.763481:0:15708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e852b9c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:15708:1874622525051776:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787779766.763570:0:15708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779766.763629:0:15708:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e8496d4240 going to sleep for 11 seconds 00000100:00100000:0.0:1787779766.767405:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525051776 00000100:00100000:0.0:1787779766.767425:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525051776 00000100:00100000:0.0:1787779766.767507:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787779766.767519:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e84517f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+18:15708:x1874622525051776:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787779766.770596:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e84517f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+18:15708:x1874622525051776:12345-0@lo:501:mount.lustre.0 Request processed in 3067us (7013us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779766.770614:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787779766.771961:0:15708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e852b9c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:15708:1874622525051776:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787779766.772043:0:15708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e852b9c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:15708:1874622525051904:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787779766.772147:0:15708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779766.772210:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525051904 00000100:00100000:3.0:1787779766.772218:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525051904 00000100:00100000:3.0:1787779766.772276:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787779766.772285:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e84517f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+18:15708:x1874622525051904:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787779766.772526:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e84517f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+18:15708:x1874622525051904:12345-0@lo:503:mount.lustre.0 Request processed in 241us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779766.772534:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787779766.773011:0:15708:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e8496d4240 going to sleep for 11 seconds 00000100:00100000:1.0:1787779766.773031:0:15708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e852b9c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:15708:1874622525051904:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787779766.777015:0:15708:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787779766.777149:0:15708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e852b9c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:15708:1874622525052032:0@lo:502:mount.lustre.0 00010000:00010000:2.0:1787779766.777788:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779766.778321:0:15708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779766.778546:0:15708:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e8496d4240 going to sleep for 11 seconds 00000100:00100000:0.0:1787779766.781240:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525052032 00000100:00100000:0.0:1787779766.781259:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525052032 00000100:00100000:1.0:1787779766.783298:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787779766.783320:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e84762a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+18:15708:x1874622525052032:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787779766.783949:0:15708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e852b9c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:15708:1874622525052032:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787779766.784368:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1787779766.784448:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1787779766.784501:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1787779766.784537:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1787779766.784571:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1787779766.784636:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1787779766.784681:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1787779766.784746:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1787779766.784804:0:15708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87fdd0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:15708:1874622525052160:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787779766.790504:0:15708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779766.790569:0:15708:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e848f403c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787779766.790674:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e84762a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+18:15708:x1874622525052032:12345-0@lo:502:mount.lustre.0 Request processed in 7358us (12351us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779766.790688:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787779766.792191:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525052160 00000100:00100000:3.0:1787779766.792207:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525052160 00000100:00100000:3.0:1787779766.792309:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787779766.792320:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e847629850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+18:15708:x1874622525052160:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787779766.792670:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e847629850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+18:15708:x1874622525052160:12345-0@lo:502:mount.lustre.0 Request processed in 352us (2177us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779766.792679:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787779766.797025:0:15708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87fdd0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:15708:1874622525052160:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787779766.797315:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1787779766.797352:0:15708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1787779766.804940:0:15713:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787779766.804957:0:15713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787779766.804960:0:15713:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787779766.804971:0:15713:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98e873adf000 00000020:00000080:3.0:1787779766.804974:0:15713:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787779766.804983:0:15713:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787779766.804985:0:15713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787779766.804987:0:15713:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787779766.804989:0:15713:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787779766.804992:0:15713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787779766.804993:0:15713:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787779766.804996:0:15713:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98e873adf000 00000020:00000080:3.0:1787779766.805011:0:15713:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787779766.805108:0:15713:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787779766.805112:0:15713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787779766.805113:0:15713:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787779766.805116:0:15713:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787779766.805119:0:15713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787779766.805121:0:15713:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787779766.805124:0:15713:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98e873adf000 00000020:00000080:3.0:1787779766.805127:0:15713:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787779766.805162:0:15713:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787779766.805165:0:15713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787779766.805166:0:15713:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787779766.805170:0:15713:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1787779766.810662:0:15708:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1787779766.810743:0:15708:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787779766.810770:0:15708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e87a94f000/0x9e63ba8af688a20d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af688a214 expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779766.810785:0:15708:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff98e87a94f000/0x9e63ba8af688a20d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af688a214 expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787779766.810848:0:15708:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787779766.810852:0:15708:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98e873adf000 10000000:01000000:1.0:1787779766.810855:0:15708:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98e873adf000 10000000:01000000:1.0:1787779766.810861:0:15708:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787779766.810867:0:15708:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98e873adf000 from 1 10000000:01000000:1.0:1787779766.810870:0:15708:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787779766.810918:0:15708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e87a94e400/0x9e63ba8af688a21b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779766.810939:0:15708:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff98e87a94e400/0x9e63ba8af688a21b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779766.810953:0:15708:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff98e87a94e400/0x9e63ba8af688a21b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779766.810985:0:15708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e852b9cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:15708:1874622525052288:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787779766.811146:0:15708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779766.811207:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525052288 00000100:00100000:1.0:1787779766.811215:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525052288 00000100:00100000:1.0:1787779766.811283:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787779766.811293:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e847628050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+18:15708:x1874622525052288:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787779766.811314:0:14301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779766.811330:0:14301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e87a94f200/0x9e63ba8af688a222 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x9e63ba8af688a21b expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779766.811361:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e87a94f200/0x9e63ba8af688a222 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9e63ba8af688a21b expref: 19 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779766.811375:0:14301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e87a94f200/0x9e63ba8af688a222 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af688a21b expref: 19 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779766.811399:0:14301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87a94f200, rc 0) 00000100:00100000:1.0:1787779766.811440:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e847628050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+19:15708:x1874622525052288:12345-0@lo:101:mount.lustre.0 Request processed in 148us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779766.813500:0:15708:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e87eb423c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787779766.813552:0:15708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e852b9cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:15708:1874622525052288:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787779766.813587:0:15708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff98e87a94e400/0x9e63ba8af688a21b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af688a222 expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779766.813602:0:15708:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff98e87a94e400/0x9e63ba8af688a21b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9e63ba8af688a222 expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787779766.814459:0:15708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:0.0:1787779766.814881:0:15708:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787779766.815182:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000100:00100000:1.0:1787779766.815236:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000040:00080000:0.0:1787779766.815244:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1787779766.815292:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1787779766.815339:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1787779766.815377:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1787779766.815442:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1787779766.815477:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1787779766.815508:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1787779766.815553:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1787779766.815599:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1787779766.815632:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1787779766.815681:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1787779766.815737:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1787779766.815774:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1787779766.815837:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1787779766.815876:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1787779766.816447:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1787779766.816534:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1787779766.816575:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1787779766.816611:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1787779766.816659:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1787779766.816697:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1787779766.816753:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1787779766.816803:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1787779766.816834:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1787779766.816862:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1787779766.816922:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1787779766.816953:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1787779766.816980:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1787779766.821519:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:1.0:1787779766.821594:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:1.0:1787779766.821630:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:1.0:1787779766.821660:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:1.0:1787779766.821704:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:1.0:1787779766.821758:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:1.0:1787779766.821811:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:1.0:1787779766.821855:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:1.0:1787779766.821950:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:1.0:1787779766.821958:0:15708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1787779766.824539:0:15708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e852b9f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:15708:1874622525052416:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787779766.824622:0:15708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779766.824685:0:15708:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e87eb420c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787779766.830343:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525052416 00000100:00100000:0.0:1787779766.830366:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525052416 00000100:00100000:0.0:1787779766.830461:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787779766.830475:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e84762bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+19:15708:x1874622525052416:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787779766.831541:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e84762bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+19:15708:x1874622525052416:12345-0@lo:501:mount.lustre.0 Request processed in 1063us (6913us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779766.831555:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787779766.831860:0:15708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e852b9f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:15708:1874622525052416:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787779766.832147:0:15708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e741e6fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:15708:1874622525052544:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787779766.832207:0:15708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779766.832245:0:15708:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e8482150c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787779766.837040:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525052544 00000100:00100000:1.0:1787779766.837064:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525052544 00000100:00100000:1.0:1787779766.837259:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787779766.837274:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e84762b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+19:15708:x1874622525052544:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787779766.838124:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e84762b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+19:15708:x1874622525052544:12345-0@lo:503:mount.lustre.0 Request processed in 851us (5913us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779766.838148:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787779766.838262:0:15708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e741e6fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:15708:1874622525052544:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787779766.839210:0:15708:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787779766.839323:0:15708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e852b9f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:15708:1874622525052672:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787779766.839501:0:15708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779766.839547:0:15708:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e87eb420c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787779766.840874:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525052672 00000100:00100000:1.0:1787779766.840892:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525052672 00000100:00100000:1.0:1787779766.840966:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787779766.840981:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e84762a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+19:15708:x1874622525052672:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787779766.841945:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e84762a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+19:15708:x1874622525052672:12345-0@lo:502:mount.lustre.0 Request processed in 965us (2440us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779766.841959:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787779766.842295:0:15708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e852b9f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:15708:1874622525052672:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787779766.843261:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1787779766.843471:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1787779766.843509:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1787779766.843565:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1787779766.843602:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1787779766.843654:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1787779766.843691:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1787779766.844139:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1787779766.844206:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1787779766.844246:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1787779766.844285:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1787779766.844337:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1787779766.844376:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1787779766.844759:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1787779766.844816:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1787779766.844854:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1787779766.844889:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1787779766.845188:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1787779766.845230:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1787779766.845271:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1787779766.845326:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1787779766.845367:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1787779766.845547:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1787779766.845605:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1787779766.845648:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1787779766.845682:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1787779766.845857:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1787779766.845900:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1787779766.846131:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1787779766.846188:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1787779766.846225:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1787779766.846260:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1787779766.846297:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1787779766.846375:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1787779766.846705:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1787779766.846865:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1787779766.846904:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1787779766.847135:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1787779766.847192:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1787779766.847232:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1787779766.847308:0:15708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e852b9f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:15708:1874622525052800:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787779766.847968:0:15708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779766.848447:0:15708:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e87eb420c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787779766.849392:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525052800 00000100:00100000:0.0:1787779766.849407:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525052800 00000100:00100000:1.0:1787779766.859853:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787779766.859872:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e847629c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+19:15708:x1874622525052800:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787779766.860693:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e847629c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+19:15708:x1874622525052800:12345-0@lo:502:mount.lustre.0 Request processed in 824us (12725us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779766.860706:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787779766.860750:0:15708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e852b9f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:15708:1874622525052800:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787779766.860893:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1787779766.861690:0:15708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1787779766.869631:0:15718:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1787779766.869654:0:15718:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff98e74121b370) 00000020:00000080:2.0:1787779766.869684:0:15718:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:2.0:1787779766.869811:0:15718:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98e873adf000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787779766.869816:0:15718:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98e873adf000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787779766.869819:0:15718:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98e873adf000 3 00010000:00080000:2.0:1787779766.869856:0:15718:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98e87a9f2800@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.109@tcp at head 00010000:00010000:3.0:1787779766.873522:0:15718:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:3.0:1787779766.874026:0:15718:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1787779766.874086:0:15718:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787779766.874105:0:15718:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x9e63ba8af688a230 00000100:00080000:3.0:1787779766.874122:0:15718:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787779766.874131:0:15718:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98e87a9f2800 using connection 192.168.201.109@tcp/0@lo 00000100:00100000:3.0:1787779766.874190:0:15718:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98e7435043c0 x1874622525052928/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787779766.874321:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e7435043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1874622525052928:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1787779766.874351:0:15718:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787779766.874431:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:0.0:1787779766.874439:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787779766.874440:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787779766.874447:0:38:0:(import.c:65:import_set_state_nolock()) ffff98e846b12800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787779766.874453:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 528 00000100:00080000:3.0:1787779766.874459:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787779766.874478:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98e846b12800 using connection 192.168.201.109@tcp/0@lo 00000100:00100000:3.0:1787779766.874496:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98e7435061c0 x1874622525053184/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787779766.874524:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525052928 00000100:00100000:0.0:1787779766.874534:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525052928 00000100:00100000:3.0:1787779766.874561:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e743506940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622525053056:0@lo:400:kworker.0 00000100:00100000:0.0:1787779766.874580:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787779766.874589:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87fdd3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3303:x1874622525052928:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787779766.874608:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787779766.874618:0:14311:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 532 last 0 00000100:00100000:3.0:1787779766.874650:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e743504f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874622525053312:0@lo:400:kworker.0 00000020:00000080:0.0:1787779766.874659:0:14311:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x9e63ba8af688a237 00000100:00100000:3.0:1787779766.874682:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00100000:0.0:1787779766.874682:0:14311:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:3.0:1787779766.874708:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:0.0:1787779766.874751:0:14311:0:(import.c:65:import_set_state_nolock()) ffff98e8745a7800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787779766.874800:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87fdd3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874622525052928:12345-0@lo:38:llog_process_th.0 Request processed in 210us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779766.874818:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787779766.874835:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525053312 00000100:00100000:0.0:1787779766.874838:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525053312 00000100:00100000:0.0:1787779766.874860:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787779766.874865:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e743504780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874622525053312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779766.874895:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e743504780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874622525053312:12345-0@lo:400:kworker.0 Request processed in 30us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779766.874902:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787779766.874929:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e7435061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874622525053184:0@lo:8:kworker.0 00000100:00100000:3.0:1787779766.874939:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e7435070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874622525053440:0@lo:400:kworker.0 00000100:00100000:0.0:1787779766.874957:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779766.874980:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787779766.875012:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e743504f00 x1874622525053312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779782 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1787779766.875014:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e7435043c0 x1874622525052928/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787779776 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779766.875036:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00100000:3.0:1787779766.875040:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e743504f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874622525053312:0@lo:400:kworker.0 00000100:00080000:0.0:1787779766.875044:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1787779766.875054:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787779766.875060:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787779766.875063:0:3303:0:(import.c:65:import_set_state_nolock()) ffff98e87a9f2800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787779766.875070:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e7435043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1874622525052928:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787779766.875083:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525053440 00000100:00100000:3.0:1787779766.875088:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525053440 00000100:00100000:3.0:1787779766.875130:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1787779766.875131:0:14305:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787779766.875141:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e743506d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874622525053440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779766.875286:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e743506d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874622525053440:12345-0@lo:400:kworker.0 Request processed in 148us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779766.875293:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787779766.876476:0:14993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525053056 00000100:00100000:2.0:1787779766.876487:0:14993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525053056 00000100:00100000:2.0:1787779766.876540:0:14993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525053184 00000100:00100000:2.0:1787779766.876544:0:14993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525053184 00000100:00100000:2.0:1787779766.876558:0:14993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787779766.876567:0:14993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e743507840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3307:x1874622525053056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779766.876646:0:14993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e743507840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3307:x1874622525053056:12345-0@lo:400:kworker.0 Request processed in 81us (2038us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779766.876667:0:14993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787779766.876686:0:14993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787779766.876690:0:14993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87fdd2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3303:x1874622525053184:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1787779766.876769:0:14993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87fdd2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3303:x1874622525053184:12345-0@lo:8:kworker.0 Request processed in 76us (1812us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787779766.876775:0:14993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1787779766.876800:0:14305:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787779766.876956:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e743506940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622525053056:0@lo:400:kworker.0 00000100:00100000:2.0:1787779766.877181:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787779766.877189:0:3303:0:(import.c:65:import_set_state_nolock()) ffff98e846b12800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787779766.877194:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787779766.877198:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e7435061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874622525053184:0@lo:8:kworker.0 00000040:00080000:3.0:1787779766.879245:0:15718:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00010000:00080000:0.0:1787779766.879555:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e7435070c0 x1874622525053440/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779782 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779766.879574:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e7435070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874622525053440:0@lo:400:kworker.0 00000020:01000000:1.0:1787779766.879659:0:15708:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1787779766.879693:0:15708:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787779766.879823:0:15708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e87a94e400/0x9e63ba8af688a21b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af688a222 expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779766.879836:0:15708:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff98e87a94e400/0x9e63ba8af688a21b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af688a222 expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787779766.879900:0:15708:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787779766.879903:0:15708:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787779766.879905:0:15708:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787779766.879906:0:15708:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787779766.879908:0:15708:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787779766.879909:0:15708:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787779766.879911:0:15708:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787779766.879913:0:15708:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787779766.879914:0:15708:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787779766.879919:0:15708:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1787779766.879922:0:15708:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787779766.879923:0:15708:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787779766.879925:0:15708:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787779766.879926:0:15708:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787779766.879927:0:15708:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787779766.879928:0:15708:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787779766.879930:0:15708:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787779766.879931:0:15708:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787779766.879932:0:15708:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787779766.879962:0:15708:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1787779766.879982:0:15708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e852b9f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:15708:1874622525053568:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787779766.881225:0:15708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779766.881296:0:15708:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e844c19f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787779766.881855:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525053568 00000100:00100000:0.0:1787779766.881865:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525053568 00000100:00100000:0.0:1787779766.881931:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787779766.881940:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e847628450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+19:15708:x1874622525053568:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787779766.881973:0:14301:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1787779766.881990:0:14301:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787779766.926960:0:14301:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787779766.927006:0:14301:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1787779766.927035:0:14325:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787779766.927040:0:14325:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787779766.927080:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98e87aa67400/0x9e63ba8af688a23e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779766.927105:0:14325:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98e848f68800/0x9e63ba8af688a118 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af688a111 expref: 19 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779766.927115:0:14325:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98e87aa67400/0x9e63ba8af688a23e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779766.927164:0:14325:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98e848f68800/0x9e63ba8af688a118 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9e63ba8af688a111 expref: 19 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779766.927198:0:14325:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98e848f68800/0x9e63ba8af688a118 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9e63ba8af688a111 expref: 19 pid: 14304 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779766.927213:0:14325:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e741e6c3c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14325:1874622525053696:0@lo:104: 00000100:00100000:2.0:1787779766.927297:0:14325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779766.927342:0:14325:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e848e5e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787779766.927374:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525053696 00000100:00100000:2.0:1787779766.927394:0:14293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525053696 00000100:00100000:2.0:1787779766.927452:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787779766.927462:0:14293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e741e6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+3:14325:x1874622525053696:12345-0@lo:104: 00010000:00010000:2.0:1787779766.927477:0:14293:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.109@tcp lock: ffff98e87a98a000/0x9e63ba8af688a111 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9e63ba8af688a118 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779766.927534:0:14293:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787779766.927541:0:14293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e741e6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+3:14325:x1874622525053696:12345-0@lo:104: Request processed in 81us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779766.927549:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1787779766.927582:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787779766.927589:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff98e87a98a000/0x9e63ba8af688a111 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9e63ba8af688a118 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779766.927597:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87a98a000 already unused, calling callback (ffffffffc1cd5c20) 10000000:00010000:2.0:1787779766.927602:0:14298:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff98e87a98a000/0x9e63ba8af688a111 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9e63ba8af688a118 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779766.927611:0:14298:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff98e87a98a000/0x9e63ba8af688a111 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9e63ba8af688a118 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787779766.927631:0:14298:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff98e87a98a000/0x9e63ba8af688a111 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9e63ba8af688a118 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787779766.927638:0:14298:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787779766.927672:0:14298:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.109@tcp lock: ffff98e87a98a000/0x9e63ba8af688a111 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af688a118 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779766.927679:0:14298:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787779766.927702:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff98e87a98a000/0x9e63ba8af688a111 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af688a118 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779766.927745:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff98e87a98a000/0x9e63ba8af688a111 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af688a118 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779766.927767:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779766.927769:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779766.927771:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787779766.927793:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e741e6d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:3306:1874622525053824:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787779766.927832:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779766.927880:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525053824 00000100:00100000:2.0:1787779766.927884:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525053824 00010000:00010000:2.0:1787779766.927902:0:14296:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98e848f68800/0x9e63ba8af688a118 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9e63ba8af688a111 expref: 20 pid: 14304 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779766.927949:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787779766.927956:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e741e6d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+20:3306:x1874622525053824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787779766.927967:0:14296:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787779766.927973:0:14296:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98e848f68800/0x9e63ba8af688a118 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9e63ba8af688a111 expref: 20 pid: 14304 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779766.927992:0:14296:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98e848f68800/0x9e63ba8af688a118 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9e63ba8af688a111 expref: 20 pid: 14304 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779766.928012:0:14296:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98e87aa67400/0x9e63ba8af688a23e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779766.928021:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e87aa67400/0x9e63ba8af688a23e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787779766.928038:0:14296:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.015599279s 00010000:00010000:2.0:1787779766.928043:0:14296:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98e87aa67400/0x9e63ba8af688a23e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779766.928051:0:14296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98e87aa67400/0x9e63ba8af688a23e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779766.928059:0:14296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98e87aa67400/0x9e63ba8af688a23e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779766.928066:0:14296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98e87aa67400/0x9e63ba8af688a23e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779766.928072:0:14296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87aa67400 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:2.0:1787779766.928078:0:14296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98e87aa67400/0x9e63ba8af688a23e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779766.928087:0:14296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98e87aa67400/0x9e63ba8af688a23e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779766.928097:0:14296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98e87aa67400/0x9e63ba8af688a23e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779766.928112:0:14296:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787779766.928142:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e741e6d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+20:3306:x1874622525053824:12345-0@lo:103:ldlm_bl.0 Request processed in 187us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779766.928150:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1787779766.928186:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e848f68800/0x9e63ba8af688a118 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9e63ba8af688a111 expref: 19 pid: 14304 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779766.928186:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e741e6d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:3306:1874622525053824:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787779766.928198:0:14325:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e741e6c3c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14325:1874622525053696:0@lo:104: 00010000:00010000:2.0:1787779766.928211:0:14325:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98e87aa67400/0x9e63ba8af688a23e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779766.928222:0:14325:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98e87aa67400/0x9e63ba8af688a23e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779766.928229:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98e87aa67400/0x9e63ba8af688a23e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779766.928236:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e87aa67400/0x9e63ba8af688a23e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779766.955698:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e847628450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+18:15708:x1874622525053568:12345-0@lo:253:mount.lustre.0 Request processed in 73742us (74459us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779766.955752:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787779766.955818:0:15708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e852b9f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:15708:1874622525053568:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787779766.955840:0:15708:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787779766.955845:0:15708:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787779766.955846:0:15708:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787779766.955848:0:15708:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787779766.955849:0:15708:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787779766.955851:0:15708:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787779766.955852:0:15708:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787779766.955854:0:15708:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787779766.955856:0:15708:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787779766.955858:0:15708:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787779766.955879:0:15708:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787779766.963354:0:15708:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1787779766.963569:0:15708:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787779766.963815:0:15708:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1787779766.963972:0:15708:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787779766.964134:0:15708:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1787779766.964341:0:15708:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1787779766.965599:0:15708:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1787779767.037766:0:15708:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1787779767.037781:0:15708:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1787779767.037827:0:15708:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787779767.037899:0:15708:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.109@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787779767.037915:0:15708:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1787779767.037956:0:15708:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00000001:00080000:3.0:1787779767.319916:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:3.0:1787779767.320229:0:6704:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1787779767.794921:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779768.242937:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787779768.242969:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87fdd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622525053952:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787779768.243173:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779768.244974:0:14995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525053952 00000100:00100000:0.0:1787779768.244992:0:14995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525053952 00000100:00100000:0.0:1787779768.245144:0:14995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787779768.245157:0:14995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e743504f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622525053952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787779768.245206:0:14995:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787779768.245292:0:14995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e743504f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622525053952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 137us (2118us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779768.245299:0:14995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787779768.245532:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1787779768.245575:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87fdd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622525053952:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787779768.247397:0:14305:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:2.0:1787779768.373454:0:14306:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787779768.373463:0:14306:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98e87f66b000 from 8 10000000:01000000:2.0:1787779768.373469:0:14306:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787779768.373535:0:14306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e87aa66a00/0x9e63ba8af688a245 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779768.373546:0:14306:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff98e87aa66a00/0x9e63ba8af688a245 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779768.373556:0:14306:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff98e87aa66a00/0x9e63ba8af688a245 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779768.373586:0:14306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e741e6f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14306:1874622525054080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787779768.373682:0:14306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779768.373776:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525054080 00000100:00100000:1.0:1787779768.373789:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525054080 00000100:00100000:2.0:1787779768.373821:0:14306:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e844d179c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787779768.373866:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787779768.373878:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e847628850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+18:14306:x1874622525054080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787779768.373898:0:14304:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779768.373922:0:14304:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e87a94ec00/0x9e63ba8af688a24c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9e63ba8af688a245 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779768.373956:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e87a94ec00/0x9e63ba8af688a24c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9e63ba8af688a245 expref: 19 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779768.373968:0:14304:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e87a94ec00/0x9e63ba8af688a24c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af688a245 expref: 19 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779768.373980:0:14304:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87a94ec00, rc 0) 00000100:00100000:1.0:1787779768.374095:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e847628850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+19:14306:x1874622525054080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 219us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779768.374129:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787779768.374220:0:14306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e741e6f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14306:1874622525054080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787779768.374239:0:14306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff98e87aa66a00/0x9e63ba8af688a245 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af688a24c expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779768.374249:0:14306:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff98e87aa66a00/0x9e63ba8af688a245 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9e63ba8af688a24c expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779768.374480:0:14306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e741e6f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14306:1874622525054208:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787779768.374522:0:14306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779768.374543:0:14306:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e844d179c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787779768.380290:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525054208 00000100:00100000:3.0:1787779768.380313:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525054208 00000100:00100000:3.0:1787779768.380432:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787779768.380446:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e847629450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+19:14306:x1874622525054208:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787779768.380484:0:14301:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787779768.380517:0:14301:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787779768.380521:0:14301:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1787779768.380793:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e847629450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+19:14306:x1874622525054208:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 349us (6269us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779768.380803:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787779768.381159:0:14306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e741e6f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14306:1874622525054208:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787779768.381270:0:14306:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787779768.381284:0:14306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e87aa66a00/0x9e63ba8af688a245 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af688a24c expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779768.381296:0:14306:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff98e87aa66a00/0x9e63ba8af688a245 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af688a24c expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779768.818975:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787779769.075454:0:14343:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787779769.844680:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779770.866923:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787779771.890861:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787779772.338941:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787779772.338947:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787779772.338952:0:36:0:(import.c:65:import_set_state_nolock()) ffff98e846b12800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787779772.338966:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98e846b12800 using connection 192.168.201.109@tcp/0@lo 00000100:00100000:2.0:1787779772.339001:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98e741e6c000 x1874622525054592/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787779772.339226:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e741e6e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:3304:1874622525054336:0@lo:400:kworker.0 00000100:00100000:2.0:1787779772.339312:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779772.339376:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e741e6c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874622525054976:0@lo:400:kworker.0 00000100:00100000:2.0:1787779772.339420:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779772.339448:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787779772.339457:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e741e6ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874622525054464:0@lo:400:kworker.0 00000100:00100000:2.0:1787779772.339707:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779772.339789:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e741e6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874622525054592:0@lo:8:kworker.0 00000100:00100000:2.0:1787779772.339823:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779772.339869:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e741e6f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874622525054720:0@lo:400:kworker.0 00000100:00100000:0.0:1787779772.339890:0:14994:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525054464 00000100:00100000:2.0:1787779772.339901:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779772.339907:0:14994:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525054464 00000100:00100000:2.0:1787779772.339930:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787779772.339938:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e741e6f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874622525054848:0@lo:400:kworker.0 00000100:00100000:2.0:1787779772.339974:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779772.339984:0:14994:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525054592 00000100:00100000:0.0:1787779772.339991:0:14994:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525054592 00000100:00100000:2.0:1787779772.340027:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525054336 00000100:00100000:0.0:1787779772.340034:0:14994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787779772.340039:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525054336 00000100:00100000:0.0:1787779772.340051:0:14994:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e741e6fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874622525054464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779772.340091:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787779772.340101:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e847628c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+19:3304:x1874622525054336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779772.340177:0:14994:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e741e6fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874622525054464:12345-0@lo:400:kworker.0 Request processed in 128us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779772.340187:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e847628c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+19:3304:x1874622525054336:12345-0@lo:400:kworker.0 Request processed in 83us (871us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779772.340197:0:14994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787779772.340208:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787779772.340235:0:14994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787779772.340242:0:14994:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e741e6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3303:x1874622525054592:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1787779772.340259:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525054976 00000100:00100000:2.0:1787779772.340266:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525054976 00010000:00080000:0.0:1787779772.340277:0:14994:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 538 last 0 00000100:00100000:2.0:1787779772.340310:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525054720 00000100:00100000:2.0:1787779772.340315:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525054720 00000020:00000080:0.0:1787779772.340334:0:14994:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9e63ba8af688a253 00000100:00100000:2.0:1787779772.340339:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525054848 00000100:00100000:2.0:1787779772.340345:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525054848 00002000:00100000:0.0:1787779772.340358:0:14994:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff98e8745a4800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113939 ocd_grant: 0 ocd_index: 1 ocd_group 0 00000100:00100000:2.0:1787779772.340370:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00002000:00080000:0.0:1787779772.340371:0:14994:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1787779772.340379:0:14994:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1787779772.340386:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e741e6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874622525054976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779772.340432:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e741e6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874622525054976:12345-0@lo:400:kworker.0 Request processed in 50us (1011us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779772.340437:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787779772.340452:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787779772.340459:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e741e6cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874622525054720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779772.340521:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e741e6cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874622525054720:12345-0@lo:400:kworker.0 Request processed in 63us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779772.340528:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787779772.340550:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787779772.340558:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f6b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874622525054848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779772.340592:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f6b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874622525054848:12345-0@lo:400:kworker.0 Request processed in 37us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779772.340599:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1787779772.340634:0:14305:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787779772.340640:0:14305:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787779772.340699:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e741e6f0c0 x1874622525054848/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779788 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779772.340767:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e741e6f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874622525054848:0@lo:400:kworker.0 00010000:00080000:2.0:1787779772.340791:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e741e6f840 x1874622525054720/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779788 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779772.340803:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e741e6f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874622525054720:0@lo:400:kworker.0 00000100:00100000:2.0:1787779772.340850:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e741e6ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874622525054464:0@lo:400:kworker.0 00000100:00100000:2.0:1787779772.340867:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e741e6e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:3304:1874622525054336:0@lo:400:kworker.0 00010000:00080000:2.0:1787779772.340889:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e741e6c3c0 x1874622525054976/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779788 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779772.340899:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e741e6c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874622525054976:0@lo:400:kworker.0 00002000:00080000:0.0:1787779772.340960:0:14994:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787779772.340998:0:14994:0:(import.c:65:import_set_state_nolock()) ffff98e8745a6800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787779772.341072:0:14994:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e741e6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3303:x1874622525054592:12345-0@lo:8:kworker.0 Request processed in 830us (1249us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779772.341081:0:14994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1787779772.344123:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e741e6c000 x1874622525054592/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787779797 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787779772.344146:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1787779772.344157:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787779772.344163:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1787779772.344166:0:3303:0:(import.c:65:import_set_state_nolock()) ffff98e846b12800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787779772.344193:0:3303:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787779772.344201:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e741e6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874622525054592:0@lo:8:kworker.0 00000004:00080000:2.0:1787779772.344235:0:14333:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787779772.344470:0:14334:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:1.0:1787779772.344503:0:14334:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e852b9f840 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14334:1874622525055232:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1787779772.344597:0:14334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779772.344640:0:14334:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e8482150c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787779772.346333:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e852b9d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874622525055104:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787779772.346405:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1787779772.347089:0:14333:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 538088375596ns, next at 0ns, rc = 0 00000100:00100000:2.0:1787779772.347124:0:14993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525055232 00000100:00100000:2.0:1787779772.347132:0:14993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525055232 00000100:00100000:2.0:1787779772.347192:0:14993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787779772.347205:0:14993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e852b9c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14334:x1874622525055232:12345-0@lo:5:osp-pre-1-0.0 00000100:00080000:3.0:1787779772.347414:0:14305:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787779772.348432:0:14995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525055104 00000100:00100000:0.0:1787779772.348446:0:14995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525055104 00000100:00100000:0.0:1787779772.348509:0:14995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787779772.348519:0:14995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e7435070c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1874622525055104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787779772.348566:0:14995:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787779772.348678:0:14995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e7435070c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1874622525055104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 159us (2271us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779772.348688:0:14995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00002000:00080000:3.0:1787779772.351767:0:14993:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1787779772.351780:0:14993:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1787779772.351786:0:14993:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:3.0:1787779772.362237:0:14993:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787779772.362253:0:14993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000110a53d4/0x9e63ba8af688a25a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779772.362301:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=538s v=(0 0) 00010000:00010000:3.0:1787779772.362308:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787779772.362317:0:14993:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000110a53d4/0x9e63ba8af688a25a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779772.362340:0:14993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000110a53d4/0x9e63ba8af688a25a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779772.362354:0:14993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000110a53d4/0x9e63ba8af688a25a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779772.362362:0:14993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000110a53d4/0x9e63ba8af688a25a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779772.362389:0:14993:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787779772.362406:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787779772.362414:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000110a53d4/0x9e63ba8af688a25a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779772.362423:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e8429d5000 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:3.0:1787779772.362429:0:14298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000110a53d4/0x9e63ba8af688a25a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779772.362440:0:14298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000110a53d4/0x9e63ba8af688a25a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779772.362471:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000110a53d4/0x9e63ba8af688a25a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779772.362479:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000110a53d4/0x9e63ba8af688a25a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779772.362502:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787779772.362504:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787779772.362506:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787779772.363080:0:14993:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787779772.363087:0:14993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ca095f8/0x9e63ba8af688a261 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779772.363098:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=538s v=(0 0) 00010000:00010000:3.0:1787779772.363101:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787779772.363106:0:14993:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ca095f8/0x9e63ba8af688a261 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779772.363116:0:14993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ca095f8/0x9e63ba8af688a261 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779772.363125:0:14993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ca095f8/0x9e63ba8af688a261 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779772.363133:0:14993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007ca095f8/0x9e63ba8af688a261 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779772.363171:0:14993:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787779772.363184:0:14297:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787779772.363189:0:14297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007ca095f8/0x9e63ba8af688a261 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779772.363197:0:14297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e8429d4000 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:3.0:1787779772.363201:0:14297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007ca095f8/0x9e63ba8af688a261 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779772.363210:0:14297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007ca095f8/0x9e63ba8af688a261 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779772.363222:0:14297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007ca095f8/0x9e63ba8af688a261 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779772.363229:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ca095f8/0x9e63ba8af688a261 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779772.363247:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787779772.363249:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787779772.363250:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:0.0:1787779772.363761:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e852b9d2c0 x1874622525055104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779788 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779772.363793:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e852b9d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874622525055104:0@lo:13:osp-pre-1-0.0 00002000:00010000:2.0:1787779772.376759:0:14993:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787779772.376776:0:14993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a4d0f41/0x9e63ba8af688a268 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.376797:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=538s v=(0 0) 00010000:00010000:2.0:1787779772.376803:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787779772.376810:0:14993:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a4d0f41/0x9e63ba8af688a268 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.376828:0:14993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004a4d0f41/0x9e63ba8af688a268 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.376839:0:14993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a4d0f41/0x9e63ba8af688a268 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.376846:0:14993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004a4d0f41/0x9e63ba8af688a268 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.376874:0:14993:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787779772.377268:0:14993:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787779772.377273:0:14993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035afe464/0x9e63ba8af688a26f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.377282:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=538s v=(0 0) 00010000:00010000:2.0:1787779772.377296:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787779772.377300:0:14993:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035afe464/0x9e63ba8af688a26f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.377322:0:14993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000035afe464/0x9e63ba8af688a26f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.377330:0:14993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035afe464/0x9e63ba8af688a26f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.377338:0:14993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000035afe464/0x9e63ba8af688a26f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.377362:0:14993:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1787779772.377835:0:14993:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787779772.377842:0:14993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003051ae0b/0x9e63ba8af688a276 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.377853:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=538s v=(0 0) 00010000:00010000:2.0:1787779772.377856:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787779772.377861:0:14993:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003051ae0b/0x9e63ba8af688a276 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.377871:0:14993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003051ae0b/0x9e63ba8af688a276 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.377879:0:14993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003051ae0b/0x9e63ba8af688a276 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.377898:0:14993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003051ae0b/0x9e63ba8af688a276 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.377906:0:14993:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1787779772.378332:0:14993:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787779772.378337:0:14993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c9cc080/0x9e63ba8af688a27d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.378346:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=538s v=(0 0) 00010000:00010000:2.0:1787779772.378349:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787779772.378353:0:14993:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c9cc080/0x9e63ba8af688a27d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.378362:0:14993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006c9cc080/0x9e63ba8af688a27d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.378370:0:14993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c9cc080/0x9e63ba8af688a27d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.378377:0:14993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006c9cc080/0x9e63ba8af688a27d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.378385:0:14993:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1787779772.378833:0:14993:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787779772.378840:0:14993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c416203/0x9e63ba8af688a284 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.378855:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=538s v=(0 0) 00010000:00010000:2.0:1787779772.378858:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787779772.378863:0:14993:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c416203/0x9e63ba8af688a284 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.378874:0:14993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001c416203/0x9e63ba8af688a284 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.378883:0:14993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c416203/0x9e63ba8af688a284 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.378892:0:14993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001c416203/0x9e63ba8af688a284 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.378902:0:14993:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:0.0:1787779772.379380:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1787779772.379390:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004a4d0f41/0x9e63ba8af688a268 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779772.379399:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87aa67600 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:0.0:1787779772.379405:0:14298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004a4d0f41/0x9e63ba8af688a268 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779772.379416:0:14298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004a4d0f41/0x9e63ba8af688a268 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779772.379442:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004a4d0f41/0x9e63ba8af688a268 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779772.379450:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004a4d0f41/0x9e63ba8af688a268 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779772.379472:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787779772.379476:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000035afe464/0x9e63ba8af688a26f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779772.379483:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87aa67200 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:0.0:1787779772.379486:0:14298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000035afe464/0x9e63ba8af688a26f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779772.379492:0:14298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000035afe464/0x9e63ba8af688a26f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779772.379509:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000035afe464/0x9e63ba8af688a26f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779772.379518:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035afe464/0x9e63ba8af688a26f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779772.379533:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787779772.379536:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003051ae0b/0x9e63ba8af688a276 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779772.379544:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87aa66000 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:0.0:1787779772.379548:0:14298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003051ae0b/0x9e63ba8af688a276 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779772.379555:0:14298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003051ae0b/0x9e63ba8af688a276 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779772.379565:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003051ae0b/0x9e63ba8af688a276 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779772.379572:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003051ae0b/0x9e63ba8af688a276 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779772.379584:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787779772.379588:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006c9cc080/0x9e63ba8af688a27d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779772.379601:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87aa66c00 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:0.0:1787779772.379604:0:14298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006c9cc080/0x9e63ba8af688a27d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779772.379612:0:14298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006c9cc080/0x9e63ba8af688a27d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779772.379621:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006c9cc080/0x9e63ba8af688a27d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779772.379629:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c9cc080/0x9e63ba8af688a27d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779772.379642:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787779772.379645:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001c416203/0x9e63ba8af688a284 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779772.379652:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87aa66200 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:0.0:1787779772.379655:0:14298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001c416203/0x9e63ba8af688a284 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779772.379663:0:14298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001c416203/0x9e63ba8af688a284 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779772.379672:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001c416203/0x9e63ba8af688a284 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779772.379687:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001c416203/0x9e63ba8af688a284 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779772.379700:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779772.379702:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779772.379704:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787779772.387407:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787779772.388690:0:14993:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787779772.388708:0:14993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c4c5017/0x9e63ba8af688a28b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.388755:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=538s v=(0 0) 00010000:00010000:2.0:1787779772.388761:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787779772.388769:0:14993:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000c4c5017/0x9e63ba8af688a28b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.388785:0:14993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000c4c5017/0x9e63ba8af688a28b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.388816:0:14993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c4c5017/0x9e63ba8af688a28b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.388826:0:14993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000c4c5017/0x9e63ba8af688a28b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.388866:0:14993:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787779772.389686:0:14993:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787779772.389695:0:14993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c23f9aa/0x9e63ba8af688a292 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.389708:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=538s v=(0 0) 00010000:00010000:2.0:1787779772.389742:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787779772.389747:0:14993:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c23f9aa/0x9e63ba8af688a292 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.389761:0:14993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c23f9aa/0x9e63ba8af688a292 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.389770:0:14993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c23f9aa/0x9e63ba8af688a292 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.389778:0:14993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007c23f9aa/0x9e63ba8af688a292 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.389811:0:14993:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1787779772.390314:0:14993:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787779772.390320:0:14993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c41c716/0x9e63ba8af688a299 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.390331:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=538s v=(0 0) 00010000:00010000:2.0:1787779772.390335:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787779772.390339:0:14993:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c41c716/0x9e63ba8af688a299 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.390349:0:14993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c41c716/0x9e63ba8af688a299 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.390358:0:14993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c41c716/0x9e63ba8af688a299 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.390365:0:14993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c41c716/0x9e63ba8af688a299 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.390373:0:14993:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1787779772.390859:0:14993:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787779772.390866:0:14993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031011311/0x9e63ba8af688a2a0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.390876:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=538s v=(0 0) 00010000:00010000:2.0:1787779772.390887:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787779772.390892:0:14993:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000031011311/0x9e63ba8af688a2a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.390904:0:14993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000031011311/0x9e63ba8af688a2a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.390913:0:14993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031011311/0x9e63ba8af688a2a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.390921:0:14993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000031011311/0x9e63ba8af688a2a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.390931:0:14993:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1787779772.391356:0:14993:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787779772.391363:0:14993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a955fbc/0x9e63ba8af688a2a7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.391371:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=538s v=(0 0) 00010000:00010000:2.0:1787779772.391374:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787779772.391378:0:14993:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a955fbc/0x9e63ba8af688a2a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.391388:0:14993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a955fbc/0x9e63ba8af688a2a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.391397:0:14993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a955fbc/0x9e63ba8af688a2a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.391412:0:14993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007a955fbc/0x9e63ba8af688a2a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.391421:0:14993:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:2.0:1787779772.391856:0:14993:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787779772.391862:0:14993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009bd9eff7/0x9e63ba8af688a2ae lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.391871:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=538s v=(0 0) 00010000:00010000:2.0:1787779772.391874:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787779772.391878:0:14993:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009bd9eff7/0x9e63ba8af688a2ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.391887:0:14993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009bd9eff7/0x9e63ba8af688a2ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.391894:0:14993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009bd9eff7/0x9e63ba8af688a2ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.391901:0:14993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009bd9eff7/0x9e63ba8af688a2ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.391908:0:14993:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:3.0:1787779772.392695:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1787779772.392707:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000c4c5017/0x9e63ba8af688a28b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779772.392751:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87aa66e00 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:3.0:1787779772.392756:0:14298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000c4c5017/0x9e63ba8af688a28b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779772.392766:0:14298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000c4c5017/0x9e63ba8af688a28b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779772.392789:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000c4c5017/0x9e63ba8af688a28b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779772.392796:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000c4c5017/0x9e63ba8af688a28b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779772.392821:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1787779772.392825:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007c23f9aa/0x9e63ba8af688a292 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779772.392831:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87aa67c00 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:3.0:1787779772.392834:0:14298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007c23f9aa/0x9e63ba8af688a292 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779772.392840:0:14298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007c23f9aa/0x9e63ba8af688a292 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779772.392849:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007c23f9aa/0x9e63ba8af688a292 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779772.392864:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c23f9aa/0x9e63ba8af688a292 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779772.392878:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787779772.392882:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c41c716/0x9e63ba8af688a299 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779772.392890:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87aa67400 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:3.0:1787779772.392893:0:14298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c41c716/0x9e63ba8af688a299 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779772.392900:0:14298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c41c716/0x9e63ba8af688a299 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779772.392910:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c41c716/0x9e63ba8af688a299 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779772.392917:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c41c716/0x9e63ba8af688a299 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779772.392929:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787779772.392933:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000031011311/0x9e63ba8af688a2a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779772.392939:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87aa66600 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:3.0:1787779772.392948:0:14298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000031011311/0x9e63ba8af688a2a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779772.392954:0:14298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000031011311/0x9e63ba8af688a2a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779772.392963:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000031011311/0x9e63ba8af688a2a0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779772.392969:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000031011311/0x9e63ba8af688a2a0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779772.392982:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787779772.392985:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007a955fbc/0x9e63ba8af688a2a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779772.392992:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87aa66800 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:3.0:1787779772.392995:0:14298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007a955fbc/0x9e63ba8af688a2a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779772.393003:0:14298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007a955fbc/0x9e63ba8af688a2a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779772.393012:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007a955fbc/0x9e63ba8af688a2a7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779772.393019:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a955fbc/0x9e63ba8af688a2a7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779772.393041:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787779772.393044:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009bd9eff7/0x9e63ba8af688a2ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779772.393051:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87aa67a00 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:3.0:1787779772.393054:0:14298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009bd9eff7/0x9e63ba8af688a2ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779772.393061:0:14298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009bd9eff7/0x9e63ba8af688a2ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779772.393071:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009bd9eff7/0x9e63ba8af688a2ae lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779772.393077:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009bd9eff7/0x9e63ba8af688a2ae lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779772.393089:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787779772.393091:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787779772.393093:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787779772.393103:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787779772.401512:0:14993:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787779772.401530:0:14993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034a88c3e/0x9e63ba8af688a2b5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.401559:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=538s v=(0 0) 00010000:00010000:2.0:1787779772.401565:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787779772.401574:0:14993:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000034a88c3e/0x9e63ba8af688a2b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.401592:0:14993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000034a88c3e/0x9e63ba8af688a2b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.401604:0:14993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034a88c3e/0x9e63ba8af688a2b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.401612:0:14993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000034a88c3e/0x9e63ba8af688a2b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.401638:0:14993:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787779772.402263:0:14993:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787779772.402269:0:14993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e845f38/0x9e63ba8af688a2bc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.402278:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=538s v=(0 0) 00010000:00010000:2.0:1787779772.402281:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787779772.402296:0:14993:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e845f38/0x9e63ba8af688a2bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.402308:0:14993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e845f38/0x9e63ba8af688a2bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.402328:0:14993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e845f38/0x9e63ba8af688a2bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.402335:0:14993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000e845f38/0x9e63ba8af688a2bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.402355:0:14993:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1787779772.402798:0:14993:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787779772.402805:0:14993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000653205bc/0x9e63ba8af688a2c3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.402814:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=538s v=(0 0) 00010000:00010000:2.0:1787779772.402817:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787779772.402822:0:14993:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000653205bc/0x9e63ba8af688a2c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.402832:0:14993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000653205bc/0x9e63ba8af688a2c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.402839:0:14993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000653205bc/0x9e63ba8af688a2c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.402846:0:14993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000653205bc/0x9e63ba8af688a2c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.402865:0:14993:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1787779772.403266:0:14993:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787779772.403272:0:14993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1d0e484/0x9e63ba8af688a2ca lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.403294:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=538s v=(0 0) 00010000:00010000:2.0:1787779772.403298:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787779772.403303:0:14993:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1d0e484/0x9e63ba8af688a2ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.403313:0:14993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1d0e484/0x9e63ba8af688a2ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.403322:0:14993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1d0e484/0x9e63ba8af688a2ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.403330:0:14993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d1d0e484/0x9e63ba8af688a2ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.403340:0:14993:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1787779772.403781:0:14993:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787779772.403788:0:14993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027e32578/0x9e63ba8af688a2d1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.403797:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=538s v=(0 0) 00010000:00010000:2.0:1787779772.403806:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787779772.403811:0:14993:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027e32578/0x9e63ba8af688a2d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.403822:0:14993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027e32578/0x9e63ba8af688a2d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.403830:0:14993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027e32578/0x9e63ba8af688a2d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.403837:0:14993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000027e32578/0x9e63ba8af688a2d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.403846:0:14993:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:2.0:1787779772.404252:0:14993:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787779772.404258:0:14993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000893ffa71/0x9e63ba8af688a2d8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.404267:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=538s v=(0 0) 00010000:00010000:2.0:1787779772.404270:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787779772.404274:0:14993:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000893ffa71/0x9e63ba8af688a2d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779772.408519:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1787779772.408542:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000034a88c3e/0x9e63ba8af688a2b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779772.408563:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e7430d3400 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:3.0:1787779772.408582:0:14298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000034a88c3e/0x9e63ba8af688a2b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779772.408597:0:14298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000034a88c3e/0x9e63ba8af688a2b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779772.408626:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000034a88c3e/0x9e63ba8af688a2b5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779772.408635:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000034a88c3e/0x9e63ba8af688a2b5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779772.408663:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787779772.408668:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000e845f38/0x9e63ba8af688a2bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779772.408674:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e7430d3a00 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:3.0:1787779772.408677:0:14298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000e845f38/0x9e63ba8af688a2bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779772.408684:0:14298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000e845f38/0x9e63ba8af688a2bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779772.408693:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000e845f38/0x9e63ba8af688a2bc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779772.408700:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e845f38/0x9e63ba8af688a2bc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779772.408747:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787779772.408751:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000653205bc/0x9e63ba8af688a2c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779772.408757:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e7430d2600 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:3.0:1787779772.408760:0:14298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000653205bc/0x9e63ba8af688a2c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779772.408769:0:14298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000653205bc/0x9e63ba8af688a2c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779772.408780:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000653205bc/0x9e63ba8af688a2c3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779772.408788:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000653205bc/0x9e63ba8af688a2c3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779772.408801:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787779772.408805:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d1d0e484/0x9e63ba8af688a2ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779772.408811:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e7430d3c00 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:3.0:1787779772.408814:0:14298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1d0e484/0x9e63ba8af688a2ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779772.408833:0:14298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1d0e484/0x9e63ba8af688a2ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779772.408843:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d1d0e484/0x9e63ba8af688a2ca lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779772.408850:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1d0e484/0x9e63ba8af688a2ca lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779772.408864:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787779772.408867:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000027e32578/0x9e63ba8af688a2d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779772.408873:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e7430d2c00 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:3.0:1787779772.408877:0:14298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000027e32578/0x9e63ba8af688a2d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779772.408884:0:14298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000027e32578/0x9e63ba8af688a2d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779772.408892:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000027e32578/0x9e63ba8af688a2d1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779772.408898:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027e32578/0x9e63ba8af688a2d1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779772.408922:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787779772.408924:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787779772.408926:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787779772.408933:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779772.411114:0:14993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000893ffa71/0x9e63ba8af688a2d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.411143:0:14993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000893ffa71/0x9e63ba8af688a2d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.411161:0:14993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000893ffa71/0x9e63ba8af688a2d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.411187:0:14993:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787779772.414553:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787779772.414575:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000893ffa71/0x9e63ba8af688a2d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779772.414601:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e7430d2000 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:3.0:1787779772.414607:0:14298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000893ffa71/0x9e63ba8af688a2d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779772.414619:0:14298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000893ffa71/0x9e63ba8af688a2d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779772.414647:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000893ffa71/0x9e63ba8af688a2d8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779772.414655:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000893ffa71/0x9e63ba8af688a2d8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779772.414682:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787779772.414684:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787779772.414686:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787779772.415441:0:14993:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787779772.415453:0:14993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000716b3aca/0x9e63ba8af688a2df lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.415469:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=538s v=(0 0) 00010000:00010000:2.0:1787779772.415474:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787779772.415481:0:14993:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000716b3aca/0x9e63ba8af688a2df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.415495:0:14993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000716b3aca/0x9e63ba8af688a2df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.415505:0:14993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000716b3aca/0x9e63ba8af688a2df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.415512:0:14993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000716b3aca/0x9e63ba8af688a2df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.415537:0:14993:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787779772.415550:0:14297:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787779772.415555:0:14297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000716b3aca/0x9e63ba8af688a2df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.415567:0:14297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e7430d3800 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:2.0:1787779772.415571:0:14297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000716b3aca/0x9e63ba8af688a2df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.415580:0:14297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000716b3aca/0x9e63ba8af688a2df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.415592:0:14297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000716b3aca/0x9e63ba8af688a2df lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.415600:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000716b3aca/0x9e63ba8af688a2df lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.415617:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779772.415618:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779772.415620:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787779772.416202:0:14993:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787779772.416210:0:14993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005037888/0x9e63ba8af688a2e6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.416220:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=538s v=(0 0) 00010000:00010000:2.0:1787779772.416223:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787779772.416227:0:14993:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005037888/0x9e63ba8af688a2e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.416238:0:14993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000005037888/0x9e63ba8af688a2e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.416253:0:14993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005037888/0x9e63ba8af688a2e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.416261:0:14993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000005037888/0x9e63ba8af688a2e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.416297:0:14993:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787779772.416780:0:14993:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787779772.416786:0:14993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071581f57/0x9e63ba8af688a2ed lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.416797:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=538s v=(0 0) 00010000:00010000:2.0:1787779772.416800:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787779772.416805:0:14993:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071581f57/0x9e63ba8af688a2ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.416815:0:14993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000071581f57/0x9e63ba8af688a2ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.416822:0:14993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071581f57/0x9e63ba8af688a2ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.416829:0:14993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000071581f57/0x9e63ba8af688a2ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.416856:0:14993:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787779772.416872:0:14297:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787779772.416877:0:14297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000005037888/0x9e63ba8af688a2e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.416883:0:14297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e7430d2200 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:2.0:1787779772.416888:0:14297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000005037888/0x9e63ba8af688a2e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.416896:0:14297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000005037888/0x9e63ba8af688a2e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.416909:0:14297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000005037888/0x9e63ba8af688a2e6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.416916:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000005037888/0x9e63ba8af688a2e6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.416932:0:14297:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787779772.416935:0:14297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000071581f57/0x9e63ba8af688a2ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.416941:0:14297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e7430d2400 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:2.0:1787779772.416943:0:14297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000071581f57/0x9e63ba8af688a2ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.416959:0:14297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000071581f57/0x9e63ba8af688a2ed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.416968:0:14297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000071581f57/0x9e63ba8af688a2ed lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.416975:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000071581f57/0x9e63ba8af688a2ed lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.416985:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779772.416987:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779772.416989:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787779772.420765:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787779772.423105:0:14993:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787779772.423126:0:14993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d67a886/0x9e63ba8af688a2f4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.423150:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=538s v=(0 0) 00010000:00010000:2.0:1787779772.423156:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787779772.423163:0:14993:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d67a886/0x9e63ba8af688a2f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.423180:0:14993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008d67a886/0x9e63ba8af688a2f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.423192:0:14993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d67a886/0x9e63ba8af688a2f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.423213:0:14993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008d67a886/0x9e63ba8af688a2f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.423257:0:14993:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787779772.423327:0:14297:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787779772.423336:0:14297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008d67a886/0x9e63ba8af688a2f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779772.423346:0:14297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e7430d3200 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:1.0:1787779772.423351:0:14297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008d67a886/0x9e63ba8af688a2f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779772.423362:0:14297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008d67a886/0x9e63ba8af688a2f4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779772.423386:0:14297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008d67a886/0x9e63ba8af688a2f4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779772.423394:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d67a886/0x9e63ba8af688a2f4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779772.423416:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779772.423418:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779772.423419:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787779772.423873:0:14993:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787779772.423879:0:14993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4470e37/0x9e63ba8af688a2fb lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.423888:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=538s v=(0 0) 00010000:00010000:2.0:1787779772.423892:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787779772.423896:0:14993:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4470e37/0x9e63ba8af688a2fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.423906:0:14993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f4470e37/0x9e63ba8af688a2fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.423914:0:14993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4470e37/0x9e63ba8af688a2fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.423922:0:14993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f4470e37/0x9e63ba8af688a2fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.423940:0:14993:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787779772.424359:0:14993:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787779772.424365:0:14993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e92eeff0/0x9e63ba8af688a302 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.424381:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=538s v=(0 0) 00010000:00010000:2.0:1787779772.424384:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787779772.424388:0:14993:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e92eeff0/0x9e63ba8af688a302 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.424400:0:14993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e92eeff0/0x9e63ba8af688a302 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.424409:0:14993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e92eeff0/0x9e63ba8af688a302 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.424417:0:14993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e92eeff0/0x9e63ba8af688a302 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.424436:0:14993:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787779772.424447:0:14297:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787779772.424451:0:14297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f4470e37/0x9e63ba8af688a2fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.424459:0:14297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e7430d2e00 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:2.0:1787779772.424464:0:14297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4470e37/0x9e63ba8af688a2fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.424473:0:14297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4470e37/0x9e63ba8af688a2fb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.424494:0:14297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f4470e37/0x9e63ba8af688a2fb lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.424502:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f4470e37/0x9e63ba8af688a2fb lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.424522:0:14297:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787779772.424526:0:14297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e92eeff0/0x9e63ba8af688a302 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.424533:0:14297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e7430d3600 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:2.0:1787779772.424537:0:14297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e92eeff0/0x9e63ba8af688a302 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.424545:0:14297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e92eeff0/0x9e63ba8af688a302 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.424553:0:14297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e92eeff0/0x9e63ba8af688a302 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.424560:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e92eeff0/0x9e63ba8af688a302 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.424572:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779772.424574:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779772.424581:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787779772.425034:0:14993:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787779772.425040:0:14993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f53e2150/0x9e63ba8af688a309 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.425050:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=538s v=(0 0) 00010000:00010000:2.0:1787779772.425053:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787779772.425057:0:14993:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f53e2150/0x9e63ba8af688a309 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.425066:0:14993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f53e2150/0x9e63ba8af688a309 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.425074:0:14993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f53e2150/0x9e63ba8af688a309 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.425081:0:14993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f53e2150/0x9e63ba8af688a309 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.425096:0:14993:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787779772.425105:0:14297:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787779772.425109:0:14297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f53e2150/0x9e63ba8af688a309 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.425117:0:14297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e7430d2800 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:2.0:1787779772.425121:0:14297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f53e2150/0x9e63ba8af688a309 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.425139:0:14297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f53e2150/0x9e63ba8af688a309 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.425150:0:14297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f53e2150/0x9e63ba8af688a309 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.425158:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f53e2150/0x9e63ba8af688a309 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.425173:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779772.425174:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779772.425176:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787779772.425579:0:14993:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787779772.425584:0:14993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f65789cd/0x9e63ba8af688a310 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.425592:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=538s v=(0 0) 00010000:00010000:2.0:1787779772.425595:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787779772.425599:0:14993:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f65789cd/0x9e63ba8af688a310 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.425607:0:14993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f65789cd/0x9e63ba8af688a310 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.425614:0:14993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f65789cd/0x9e63ba8af688a310 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.425629:0:14993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f65789cd/0x9e63ba8af688a310 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.425643:0:14993:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787779772.425651:0:14297:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787779772.425654:0:14297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f65789cd/0x9e63ba8af688a310 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.425661:0:14297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e7430d3e00 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:2.0:1787779772.425665:0:14297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f65789cd/0x9e63ba8af688a310 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.425671:0:14297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f65789cd/0x9e63ba8af688a310 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.425682:0:14297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f65789cd/0x9e63ba8af688a310 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.425691:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f65789cd/0x9e63ba8af688a310 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.425706:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779772.425708:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779772.425732:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787779772.426148:0:14993:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787779772.426161:0:14993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7e8c494/0x9e63ba8af688a317 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.426171:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=538s v=(0 0) 00010000:00010000:2.0:1787779772.426174:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787779772.426178:0:14993:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7e8c494/0x9e63ba8af688a317 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.426188:0:14993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7e8c494/0x9e63ba8af688a317 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.426195:0:14993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7e8c494/0x9e63ba8af688a317 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.426202:0:14993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e7e8c494/0x9e63ba8af688a317 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.426218:0:14993:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787779772.426228:0:14297:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787779772.426232:0:14297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e7e8c494/0x9e63ba8af688a317 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.426238:0:14297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e7430d2a00 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:2.0:1787779772.426241:0:14297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7e8c494/0x9e63ba8af688a317 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.426248:0:14297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7e8c494/0x9e63ba8af688a317 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.426266:0:14297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e7e8c494/0x9e63ba8af688a317 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779772.426273:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7e8c494/0x9e63ba8af688a317 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779772.428588:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1787779772.435214:0:14993:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:0.0:1787779772.441074:0:14993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e852b9c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14334:x1874622525055232:12345-0@lo:5:osp-pre-1-0.0 Request processed in 93859us (96465us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779772.441087:0:14334:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e852b9f840 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14334:1874622525055232:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1787779772.441095:0:14993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:1.0:1787779772.441520:0:14334:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:1.0:1787779772.441595:0:14334:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e852b9f840 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14334:1874622525055360:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1787779772.441647:0:14334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779772.441703:0:14334:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e8482150c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787779772.441752:0:14994:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525055360 00010000:00010000:2.0:1787779772.441755:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779772.441759:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779772.441760:0:14994:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525055360 00010000:00010000:2.0:1787779772.441761:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779772.441812:0:14994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787779772.441824:0:14994:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e852b9ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14334:x1874622525055360:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1787779772.441887:0:14994:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000004:00080000:2.0:1787779772.446215:0:5857:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:1.0:1787779772.454183:0:14994:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e852b9ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14334:x1874622525055360:12345-0@lo:5:osp-pre-1-0.0 Request processed in 12352us (12526us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1787779772.454201:0:14994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787779772.460387:0:14334:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e852b9f840 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14334:1874622525055360:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1787779772.460416:0:14334:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:3.0:1787779772.916933:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779773.362969:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87fdd30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622525055488:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787779773.363083:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779773.363193:0:14995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525055488 00000100:00100000:0.0:1787779773.363203:0:14995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525055488 00000100:00100000:0.0:1787779773.363291:0:14995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787779773.363302:0:14995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87fdd0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622525055488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787779773.363351:0:14995:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787779773.363406:0:14995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87fdd0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622525055488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779773.363414:0:14995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787779773.363474:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87fdd30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622525055488:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787779773.940820:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779774.966164:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787779775.116014:0:16066:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg109-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787779775.986886:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779777.011048:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779777.459472:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787779777.459495:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e7435043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622525055616:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787779777.459564:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779777.459634:0:14995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525055616 00000100:00100000:3.0:1787779777.459641:0:14995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525055616 00000100:00100000:3.0:1787779777.460240:0:14995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787779777.460254:0:14995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e7435061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1874622525055616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787779777.460294:0:14995:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787779777.460356:0:14995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e7435061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1874622525055616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (792us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779777.460364:0:14995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1787779777.460386:0:14305:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787779777.460424:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e7435043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622525055616:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787779777.460947:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f6b70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874622525055872:0@lo:400:kworker.0 00000100:00100000:2.0:1787779777.461213:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779777.461250:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787779777.461256:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f6b52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:3305:1874622525055744:0@lo:400:kworker.0 00000100:00100000:2.0:1787779777.461287:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779777.461313:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f6b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874622525056256:0@lo:400:kworker.0 00000100:00100000:2.0:1787779777.461340:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779777.461365:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f6b5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874622525056128:0@lo:400:kworker.0 00000100:00100000:2.0:1787779777.461388:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779777.461541:0:14993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525055872 00000100:00100000:0.0:1787779777.461548:0:14993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525055872 00000100:00100000:0.0:1787779777.461602:0:14993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787779777.461611:0:14993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f6b6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874622525055872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779777.461663:0:14993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f6b6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874622525055872:12345-0@lo:400:kworker.0 Request processed in 54us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779777.461670:0:14993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787779777.461806:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787779777.461881:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f6b61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874622525056000:0@lo:400:kworker.0 00000100:00100000:2.0:1787779777.461911:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779777.461938:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525055744 00000100:00100000:2.0:1787779777.461949:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525055744 00000100:00100000:2.0:1787779777.461978:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787779777.461984:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e84762a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+19:3305:x1874622525055744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779777.462248:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e84762a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+19:3305:x1874622525055744:12345-0@lo:400:kworker.0 Request processed in 263us (960us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779777.462255:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787779777.462292:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525056256 00000100:00100000:2.0:1787779777.462296:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525056256 00000100:00100000:2.0:1787779777.462316:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525056128 00000100:00100000:2.0:1787779777.462319:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525056128 00000100:00100000:2.0:1787779777.462333:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525056000 00000100:00100000:2.0:1787779777.462336:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525056000 00000100:00100000:2.0:1787779777.462352:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787779777.462358:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f6b5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874622525056256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779777.462388:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f6b5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874622525056256:12345-0@lo:400:kworker.0 Request processed in 30us (1047us total) trans 0 rc 0/0 00000100:00080000:3.0:1787779777.462467:0:14305:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787779777.462472:0:14305:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787779777.462978:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787779777.463225:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787779777.463235:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f6b4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874622525056128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779777.463352:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f6b4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874622525056128:12345-0@lo:400:kworker.0 Request processed in 120us (1963us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779777.463360:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787779777.463373:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787779777.463380:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f6b43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874622525056000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779777.463424:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f6b43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874622525056000:12345-0@lo:400:kworker.0 Request processed in 44us (1512us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779777.463429:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787779777.465576:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f6b52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:3305:1874622525055744:0@lo:400:kworker.0 00010000:00080000:2.0:1787779777.468974:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e87f6b7480 x1874622525056256/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779793 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779777.469579:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f6b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874622525056256:0@lo:400:kworker.0 00000100:00100000:2.0:1787779777.469604:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f6b70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874622525055872:0@lo:400:kworker.0 00010000:00080000:3.0:1787779777.477862:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e87f6b5e00 x1874622525056128/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779793 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779777.477885:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f6b5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874622525056128:0@lo:400:kworker.0 00010000:00080000:3.0:1787779777.478068:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e87f6b61c0 x1874622525056000/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779793 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779777.478080:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f6b61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874622525056000:0@lo:400:kworker.0 00000001:00100000:3.0:1787779777.595558:0:7634:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1787779777.595574:0:7634:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000100:00100000:0.0:1787779777.974335:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779777.974445:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505132800 00000100:00100000:2.0:1787779777.974456:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505132800 00000100:00100000:2.0:1787779777.974518:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 76 00000100:00100000:2.0:1787779777.974528:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e84762b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2356:x1874622505132800:12345-192.168.201.9@tcp:250:mount.lustre.0 00010000:00080000:2.0:1787779777.974560:0:14301:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from b38d1ba0-13da-4ef7-a48d-bd7b24ab8218@192.168.201.9@tcp t0 exp 0000000000000000 cur 543 last 0 00000020:00000080:2.0:1787779777.974590:0:14301:0:(genops.c:1385:class_connect()) connect: client b38d1ba0-13da-4ef7-a48d-bd7b24ab8218, cookie 0x9e63ba8af688a31e 00000100:00080000:2.0:1787779777.974825:0:14301:0:(import.c:65:import_set_state_nolock()) ffff98e87a9f6800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787779777.974905:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e84762b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b38d1ba0-13da-4ef7-a48d-bd7b24ab8218+5:2356:x1874622505132800:12345-192.168.201.9@tcp:250:mount.lustre.0 Request processed in 377us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779777.974915:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 76 00000100:00100000:1.0:1787779777.995210:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779777.995367:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505132928 00000100:00100000:2.0:1787779777.995378:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505132928 00000100:00100000:2.0:1787779777.995439:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 77 00000100:00100000:2.0:1787779777.995449:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e84762b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b38d1ba0-13da-4ef7-a48d-bd7b24ab8218+5:13761:x1874622505132928:12345-192.168.201.9@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787779777.995468:0:14304:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779777.995488:0:14304:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e7430d3800/0x9e63ba8af688a325 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedaff9 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779777.995520:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e7430d3800/0x9e63ba8af688a325 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaff9 expref: 6 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779777.995550:0:14304:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e7430d3800/0x9e63ba8af688a325 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedaff9 expref: 6 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779777.995560:0:14304:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e7430d3800, rc 0) 00000100:00100000:2.0:1787779777.996226:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e84762b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b38d1ba0-13da-4ef7-a48d-bd7b24ab8218+6:13761:x1874622505132928:12345-192.168.201.9@tcp:101:mount.lustre.0 Request processed in 772us (1020us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779777.996236:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 77 00000100:00100000:3.0:1787779778.024901:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779778.025137:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505133056 00000100:00100000:0.0:1787779778.025150:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505133056 00000100:00100000:0.0:1787779778.025221:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 78 00000100:00100000:0.0:1787779778.025234:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e847629050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b38d1ba0-13da-4ef7-a48d-bd7b24ab8218+6:13761:x1874622505133056:12345-192.168.201.9@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787779778.025749:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e847629050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b38d1ba0-13da-4ef7-a48d-bd7b24ab8218+6:13761:x1874622505133056:12345-192.168.201.9@tcp:501:mount.lustre.0 Request processed in 516us (855us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787779778.025759:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 78 00000100:00100000:0.0:1787779778.028264:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779778.028918:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505133184 00000100:00100000:2.0:1787779778.028928:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505133184 00000100:00100000:2.0:1787779778.029105:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 79 00000100:00100000:2.0:1787779778.029116:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e85f557850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b38d1ba0-13da-4ef7-a48d-bd7b24ab8218+6:13761:x1874622505133184:12345-192.168.201.9@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787779778.029145:0:14304:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779778.029171:0:14304:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e7430d3000/0x9e63ba8af688a32c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedb000 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779778.029211:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e7430d3000/0x9e63ba8af688a32c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb000 expref: 7 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779778.029222:0:14304:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e7430d3000/0x9e63ba8af688a32c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb000 expref: 7 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779778.029232:0:14304:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e7430d3000, rc 0) 00000100:00100000:2.0:1787779778.029313:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e85f557850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b38d1ba0-13da-4ef7-a48d-bd7b24ab8218+7:13761:x1874622505133184:12345-192.168.201.9@tcp:101:mount.lustre.0 Request processed in 199us (1059us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779778.029321:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 79 00010000:00010000:2.0:1787779778.042758:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779778.043076:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779778.043689:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505133312 00000100:00100000:0.0:1787779778.043700:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505133312 00000100:00100000:0.0:1787779778.046419:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 80 00000100:00100000:0.0:1787779778.046436:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e85f555450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b38d1ba0-13da-4ef7-a48d-bd7b24ab8218+7:13761:x1874622505133312:12345-192.168.201.9@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787779778.046833:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e85f555450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b38d1ba0-13da-4ef7-a48d-bd7b24ab8218+8:13761:x1874622505133312:12345-192.168.201.9@tcp:501:mount.lustre.0 Request processed in 399us (3760us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779778.046842:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 80 00000100:00100000:2.0:1787779778.054059:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779778.054257:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505133440 00000100:00100000:0.0:1787779778.054269:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505133440 00000100:00100000:0.0:1787779778.054376:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 81 00000100:00100000:0.0:1787779778.054387:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e85f555050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b38d1ba0-13da-4ef7-a48d-bd7b24ab8218+8:13761:x1874622505133440:12345-192.168.201.9@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787779778.054704:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e85f555050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b38d1ba0-13da-4ef7-a48d-bd7b24ab8218+8:13761:x1874622505133440:12345-192.168.201.9@tcp:503:mount.lustre.0 Request processed in 317us (920us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779778.054749:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 81 00000100:00100000:1.0:1787779778.060636:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779778.061244:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505133568 00000100:00100000:0.0:1787779778.061255:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505133568 00000100:00100000:0.0:1787779778.061313:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 82 00000100:00100000:0.0:1787779778.061324:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e85f556450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b38d1ba0-13da-4ef7-a48d-bd7b24ab8218+8:13779:x1874622505133568:12345-192.168.201.9@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787779778.061651:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e85f556450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b38d1ba0-13da-4ef7-a48d-bd7b24ab8218+8:13779:x1874622505133568:12345-192.168.201.9@tcp:502:llog_process_th.0 Request processed in 328us (1029us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779778.061660:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 82 00000100:00100000:1.0:1787779778.093841:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779778.095119:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505133696 00000100:00100000:0.0:1787779778.095142:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505133696 00000100:00100000:0.0:1787779778.095227:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 83 00000100:00100000:0.0:1787779778.095240:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e85f554850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b38d1ba0-13da-4ef7-a48d-bd7b24ab8218+8:13779:x1874622505133696:12345-192.168.201.9@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787779778.095572:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e85f554850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b38d1ba0-13da-4ef7-a48d-bd7b24ab8218+8:13779:x1874622505133696:12345-192.168.201.9@tcp:502:llog_process_th.0 Request processed in 334us (1742us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779778.095580:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 83 00000100:00100000:2.0:1787779778.117296:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779778.117426:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505133824 00000100:00100000:3.0:1787779778.117436:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505133824 00000100:00100000:3.0:1787779778.117483:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 84 00000100:00100000:3.0:1787779778.117492:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e85f554050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b38d1ba0-13da-4ef7-a48d-bd7b24ab8218+8:13761:x1874622505133824:12345-192.168.201.9@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787779778.117510:0:14301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779778.117530:0:14301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e8429d4000/0x9e63ba8af688a333 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedb02a expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779778.117562:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e8429d4000/0x9e63ba8af688a333 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb02a expref: 9 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779778.117573:0:14301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e8429d4000/0x9e63ba8af688a333 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb02a expref: 9 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779778.117584:0:14301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e8429d4000, rc 0) 00000100:00100000:3.0:1787779778.117702:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e85f554050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b38d1ba0-13da-4ef7-a48d-bd7b24ab8218+9:13761:x1874622505133824:12345-192.168.201.9@tcp:101:mount.lustre.0 Request processed in 210us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779778.117738:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 84 00000100:00100000:1.0:1787779778.122481:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779778.122699:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505133952 00000100:00100000:2.0:1787779778.122743:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505133952 00000100:00100000:2.0:1787779778.122809:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 85 00000100:00100000:2.0:1787779778.122820:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e85f556c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b38d1ba0-13da-4ef7-a48d-bd7b24ab8218+9:13761:x1874622505133952:12345-192.168.201.9@tcp:256:mount.lustre.0 20000000:01000000:2.0:1787779778.122846:0:14303:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787779778.122869:0:14303:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787779778.122874:0:14303:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787779778.122877:0:14303:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787779778.122880:0:14303:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1787779778.124895:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e85f556c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b38d1ba0-13da-4ef7-a48d-bd7b24ab8218+9:13761:x1874622505133952:12345-192.168.201.9@tcp:256:mount.lustre.0 Request processed in 2065us (2412us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779778.124908:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 85 00000100:00100000:0.0:1787779778.130609:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779778.130840:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505134080 00000100:00100000:2.0:1787779778.130850:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505134080 00000100:00100000:2.0:1787779778.130907:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 86 00000100:00100000:2.0:1787779778.130917:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e85f556050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b38d1ba0-13da-4ef7-a48d-bd7b24ab8218+9:13761:x1874622505134080:12345-192.168.201.9@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787779778.130936:0:14304:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779778.130953:0:14304:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e7430d2400/0x9e63ba8af688a33a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedb031 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779778.130994:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e7430d2400/0x9e63ba8af688a33a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb031 expref: 10 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779778.131007:0:14304:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e7430d2400/0x9e63ba8af688a33a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb031 expref: 10 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779778.131016:0:14304:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e7430d2400, rc 0) 00000100:00100000:2.0:1787779778.131229:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e85f556050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b38d1ba0-13da-4ef7-a48d-bd7b24ab8218+10:13761:x1874622505134080:12345-192.168.201.9@tcp:101:mount.lustre.0 Request processed in 312us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779778.131236:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 86 00000100:00100000:1.0:1787779778.135402:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779778.135480:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505134208 00000100:00100000:2.0:1787779778.135491:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505134208 00000100:00100000:2.0:1787779778.135548:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 87 00000100:00100000:2.0:1787779778.135559:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e85f557450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b38d1ba0-13da-4ef7-a48d-bd7b24ab8218+10:13761:x1874622505134208:12345-192.168.201.9@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787779778.136255:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e85f557450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b38d1ba0-13da-4ef7-a48d-bd7b24ab8218+10:13761:x1874622505134208:12345-192.168.201.9@tcp:501:mount.lustre.0 Request processed in 696us (861us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779778.136265:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 87 00000100:00100000:0.0:1787779778.138627:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779778.138706:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505134336 00000100:00100000:2.0:1787779778.138739:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505134336 00000100:00100000:2.0:1787779778.138967:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 88 00000100:00100000:2.0:1787779778.139046:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e85f555c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b38d1ba0-13da-4ef7-a48d-bd7b24ab8218+10:13761:x1874622505134336:12345-192.168.201.9@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787779778.139451:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e85f555c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b38d1ba0-13da-4ef7-a48d-bd7b24ab8218+10:13761:x1874622505134336:12345-192.168.201.9@tcp:503:mount.lustre.0 Request processed in 474us (833us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779778.139459:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 88 00000100:00100000:0.0:1787779778.152177:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779778.157428:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505134464 00000100:00100000:3.0:1787779778.157447:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505134464 00000100:00100000:3.0:1787779778.157519:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 89 00000100:00100000:3.0:1787779778.157530:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e85f554c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b38d1ba0-13da-4ef7-a48d-bd7b24ab8218+10:13784:x1874622505134464:12345-192.168.201.9@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787779778.158325:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e85f554c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b38d1ba0-13da-4ef7-a48d-bd7b24ab8218+10:13784:x1874622505134464:12345-192.168.201.9@tcp:502:llog_process_th.0 Request processed in 792us (6157us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779778.158347:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 89 00000100:00100000:0.0:1787779778.175590:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779778.175683:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505134592 00000100:00100000:2.0:1787779778.175693:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505134592 00000100:00100000:2.0:1787779778.175794:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 90 00000100:00100000:2.0:1787779778.176040:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e85f555850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b38d1ba0-13da-4ef7-a48d-bd7b24ab8218+10:13784:x1874622505134592:12345-192.168.201.9@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787779778.176325:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e85f555850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b38d1ba0-13da-4ef7-a48d-bd7b24ab8218+10:13784:x1874622505134592:12345-192.168.201.9@tcp:502:llog_process_th.0 Request processed in 522us (748us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779778.176334:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 90 00000100:00100000:1.0:1787779778.184250:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779778.184771:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505134720 00000100:00100000:2.0:1787779778.184794:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505134720 00000100:00100000:2.0:1787779778.184991:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 4 00000100:00100000:2.0:1787779778.184999:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e852b9e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2356:x1874622505134720:12345-192.168.201.9@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787779778.185028:0:14309:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 43b382b8-5aec-409a-8dc5-84d259a200e7@192.168.201.9@tcp t0 exp 0000000000000000 cur 543 last 0 00000020:00000080:2.0:1787779778.185079:0:14309:0:(genops.c:1385:class_connect()) connect: client 43b382b8-5aec-409a-8dc5-84d259a200e7, cookie 0x9e63ba8af688a341 00000004:00100000:2.0:1787779778.185108:0:14309:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1787779778.185113:0:14309:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:0.0:1787779778.253391:0:14309:0:(import.c:65:import_set_state_nolock()) ffff98e8745a3800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787779778.253475:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e852b9e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:43b382b8-5aec-409a-8dc5-84d259a200e7+6:2356:x1874622505134720:12345-192.168.201.9@tcp:38:mount.lustre.0 Request processed in 68474us (69237us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779778.253486:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 4 00000100:00100000:0.0:1787779778.257272:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779778.257319:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779778.257428:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505134976 00000100:00100000:1.0:1787779778.257440:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505134976 00000100:00100000:1.0:1787779778.257510:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505134848 00000100:00100000:1.0:1787779778.257514:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505134848 00000100:00100000:1.0:1787779778.257532:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 5 00000100:00100000:1.0:1787779778.257541:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87fdd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:43b382b8-5aec-409a-8dc5-84d259a200e7+7:13761:x1874622505134976:12345-192.168.201.9@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787779778.257591:0:14310:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787779778.257685:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87fdd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:43b382b8-5aec-409a-8dc5-84d259a200e7+7:13761:x1874622505134976:12345-192.168.201.9@tcp:41:mount.lustre.0 Request processed in 144us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779778.257693:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 5 00000100:00100000:1.0:1787779778.257746:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 6 00000100:00100000:1.0:1787779778.257754:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87fdd30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:43b382b8-5aec-409a-8dc5-84d259a200e7+6:0:x1874622505134848:12345-192.168.201.9@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787779778.257765:0:14310:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00080000:3.0:1787779778.257930:0:14305:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787779778.257966:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87fdd30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:43b382b8-5aec-409a-8dc5-84d259a200e7+6:0:x1874622505134848:12345-192.168.201.9@tcp:41:mount.lustre.0 Request processed in 212us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779778.257974:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 6 00000100:00100000:3.0:1787779778.259976:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779778.260229:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505135104 00000100:00100000:1.0:1787779778.260239:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505135104 00000100:00100000:1.0:1787779778.260305:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 7 00000100:00100000:1.0:1787779778.260318:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e7435043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:43b382b8-5aec-409a-8dc5-84d259a200e7+6:13761:x1874622505135104:12345-192.168.201.9@tcp:40:mount.lustre.0 00000100:00100000:1.0:1787779778.260405:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e7435043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:43b382b8-5aec-409a-8dc5-84d259a200e7+6:13761:x1874622505135104:12345-192.168.201.9@tcp:40:mount.lustre.0 Request processed in 91us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779778.260414:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 7 00000100:00100000:1.0:1787779778.262843:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779778.262998:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505135488 00000100:00100000:0.0:1787779778.263008:0:14312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505135488 00000100:00100000:0.0:1787779778.263062:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 0 00000100:00100000:0.0:1787779778.263073:0:14312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e852b9cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:43b382b8-5aec-409a-8dc5-84d259a200e7+6:13761:x1874622505135488:12345-192.168.201.9@tcp:33:mount.lustre.0 00000004:00080000:0.0:1787779778.267328:0:14312:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 4170us 00000100:00100000:3.0:1787779778.270499:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779778.270547:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779778.270650:0:14993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505135232 00000100:00100000:0.0:1787779778.270663:0:14993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505135232 00000100:00100000:0.0:1787779778.270706:0:14993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505135360 00000100:00100000:0.0:1787779778.270731:0:14993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505135360 00000100:00100000:0.0:1787779778.270749:0:14993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 8 00000100:00100000:0.0:1787779778.270757:0:14993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e743506940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2356:x1874622505135232:12345-192.168.201.9@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787779778.270808:0:14993:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 43b382b8-5aec-409a-8dc5-84d259a200e7@192.168.201.9@tcp t0 exp 0000000000000000 cur 544 last 0 00000020:00000080:0.0:1787779778.270841:0:14993:0:(genops.c:1385:class_connect()) connect: client 43b382b8-5aec-409a-8dc5-84d259a200e7, cookie 0x9e63ba8af688a348 00002000:00100000:0.0:1787779778.270854:0:14993:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 43b382b8-5aec-409a-8dc5-84d259a200e7/ffff98e8745a5000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113939 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787779778.270877:0:14993:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787779778.271237:0:14993:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787779778.271268:0:14993:0:(import.c:65:import_set_state_nolock()) ffff98e8745a4000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787779778.271342:0:14993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e743506940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:43b382b8-5aec-409a-8dc5-84d259a200e7+6:2356:x1874622505135232:12345-192.168.201.9@tcp:8:mount.lustre.0 Request processed in 585us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779778.271350:0:14993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 8 00000100:00100000:0.0:1787779778.271369:0:14993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 9 00000100:00100000:0.0:1787779778.271374:0:14993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e743505a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2356:x1874622505135360:12345-192.168.201.9@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787779778.271390:0:14993:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 43b382b8-5aec-409a-8dc5-84d259a200e7@192.168.201.9@tcp t0 exp 0000000000000000 cur 544 last 0 00000020:00000080:0.0:1787779778.271409:0:14993:0:(genops.c:1385:class_connect()) connect: client 43b382b8-5aec-409a-8dc5-84d259a200e7, cookie 0x9e63ba8af688a34f 00002000:00100000:0.0:1787779778.271414:0:14993:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 43b382b8-5aec-409a-8dc5-84d259a200e7/ffff98e8745a2000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113939 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787779778.271430:0:14993:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787779778.271621:0:14993:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787779778.271636:0:14993:0:(import.c:65:import_set_state_nolock()) ffff98e8745a1800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787779778.271657:0:14993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e743505a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:43b382b8-5aec-409a-8dc5-84d259a200e7+6:2356:x1874622505135360:12345-192.168.201.9@tcp:8:mount.lustre.0 Request processed in 282us (1110us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779778.271663:0:14993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 9 00000004:00200000:2.0:1787779778.286482:0:14312:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:2.0:1787779778.286680:0:14312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e852b9cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:43b382b8-5aec-409a-8dc5-84d259a200e7+6:13761:x1874622505135488:12345-192.168.201.9@tcp:33:mount.lustre.0 Request processed in 23602us (23842us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779778.286695:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 0 00000100:00100000:3.0:1787779778.483225:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787779778.483249:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87fdd1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874622525056384:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787779778.483322:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779778.483413:0:14995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525056384 00000100:00100000:3.0:1787779778.483422:0:14995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525056384 00000100:00100000:3.0:1787779778.483473:0:14995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787779778.483481:0:14995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec9d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874622525056384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787779778.483503:0:14995:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787779778.483550:0:14995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec9d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874622525056384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779778.483556:0:14995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787779778.483602:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87fdd1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874622525056384:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787779778.529336:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779778.531117:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505135616 00000100:00100000:0.0:1787779778.531142:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505135616 00000100:00100000:0.0:1787779778.531232:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 8 00000100:00100000:0.0:1787779778.531242:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec9e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:43b382b8-5aec-409a-8dc5-84d259a200e7+6:13805:x1874622505135616:12345-192.168.201.9@tcp:101:mkdir.0 00010000:00010000:0.0:1787779778.531265:0:14309:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787779778.531291:0:14309:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69c00/0x9e63ba8af688a356 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedb05b expref: -99 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779778.531355:0:14309:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af688a35d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779778.531370:0:14309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af688a35d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779778.531385:0:14309:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af688a35d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787779778.531582:0:14309:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787779778.531586:0:14309:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1787779778.531697:0:14309:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af688a35d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779778.531759:0:14309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69c00/0x9e63ba8af688a356 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb05b expref: 8 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779778.531786:0:14309:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af688a35d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb05b expref: 7 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779778.531795:0:14309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e860e78a00) 00010000:00010000:0.0:1787779778.531798:0:14309:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787779778.531801:0:14309:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e848f69800, rc 0) 00000100:00100000:0.0:1787779778.531874:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec9e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:43b382b8-5aec-409a-8dc5-84d259a200e7+7:13805:x1874622505135616:12345-192.168.201.9@tcp:101:mkdir.0 Request processed in 633us (2549us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779778.531881:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 8 00010000:00010000:0.0:1787779779.058943:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787779779.318034:0:14343:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787779780.084182:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787779780.670068:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779780.670124:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505135744 00000100:00100000:0.0:1787779780.670134:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505135744 00000100:00080000:3.0:1787779780.670208:0:14305:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787779780.670224:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 9 00000100:00100000:0.0:1787779780.670236:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f6b70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:43b382b8-5aec-409a-8dc5-84d259a200e7+7:13857:x1874622505135744:12345-192.168.201.9@tcp:41:lfs.0 00000004:00000024:0.0:1787779780.670280:0:14311:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787779780.670362:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f6b70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:43b382b8-5aec-409a-8dc5-84d259a200e7+7:13857:x1874622505135744:12345-192.168.201.9@tcp:41:lfs.0 Request processed in 128us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779780.670370:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 9 00000100:00100000:2.0:1787779780.672850:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779780.673280:0:14995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505135872 00000100:00100000:3.0:1787779780.673289:0:14995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505135872 00000100:00100000:3.0:1787779780.673366:0:14995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 6 00000100:00100000:3.0:1787779780.673377:0:14995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f6b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:43b382b8-5aec-409a-8dc5-84d259a200e7+6:13857:x1874622505135872:12345-192.168.201.9@tcp:13:lfs.0 00002000:00000024:3.0:1787779780.673412:0:14995:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787779780.673568:0:14995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f6b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:43b382b8-5aec-409a-8dc5-84d259a200e7+6:13857:x1874622505135872:12345-192.168.201.9@tcp:13:lfs.0 Request processed in 191us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779780.673589:0:14995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 6 00000100:00080000:0.0:1787779780.673658:0:14305:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787779780.677673:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779780.677741:0:14995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505136000 00000100:00100000:0.0:1787779780.677751:0:14995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505136000 00000100:00100000:0.0:1787779780.677884:0:14995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 7 00000100:00100000:0.0:1787779780.677895:0:14995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec9c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:43b382b8-5aec-409a-8dc5-84d259a200e7+6:13857:x1874622505136000:12345-192.168.201.9@tcp:13:lfs.0 00002000:00000024:0.0:1787779780.677935:0:14995:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787779780.678023:0:14995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec9c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:43b382b8-5aec-409a-8dc5-84d259a200e7+6:13857:x1874622505136000:12345-192.168.201.9@tcp:13:lfs.0 Request processed in 130us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779780.678044:0:14995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 7 00000100:00080000:3.0:1787779780.678643:0:14305:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787779780.971035:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779780.971448:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505136128 00000100:00100000:0.0:1787779780.971459:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505136128 00000100:00100000:0.0:1787779780.971521:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 91 00000100:00100000:0.0:1787779780.971531:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e85f557c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b38d1ba0-13da-4ef7-a48d-bd7b24ab8218+10:13890:x1874622505136128:12345-192.168.201.9@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787779780.971548:0:14303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787779780.971566:0:14303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e848f69c00/0x9e63ba8af688a364 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedb062 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779780.971613:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e848f69c00/0x9e63ba8af688a364 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb062 expref: 11 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779780.971622:0:14303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e848f69c00/0x9e63ba8af688a364 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb062 expref: 11 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779780.971630:0:14303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e848f69c00, rc 0) 00000100:00100000:0.0:1787779780.971684:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e85f557c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b38d1ba0-13da-4ef7-a48d-bd7b24ab8218+11:13890:x1874622505136128:12345-192.168.201.9@tcp:101:mount.lustre.0 Request processed in 155us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779780.971691:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 91 00000100:00100000:2.0:1787779780.997665:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779780.997790:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505136256 00000100:00100000:3.0:1787779780.997799:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505136256 00000100:00100000:3.0:1787779780.997855:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 92 00000100:00100000:3.0:1787779780.997867:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e85f557050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b38d1ba0-13da-4ef7-a48d-bd7b24ab8218+11:13890:x1874622505136256:12345-192.168.201.9@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787779780.998186:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e85f557050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b38d1ba0-13da-4ef7-a48d-bd7b24ab8218+11:13890:x1874622505136256:12345-192.168.201.9@tcp:501:mount.lustre.0 Request processed in 320us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779780.998195:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 92 00000100:00100000:3.0:1787779781.003399:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779781.003531:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505136384 00000100:00100000:2.0:1787779781.003540:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505136384 00000100:00100000:2.0:1787779781.003597:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 93 00000100:00100000:2.0:1787779781.003616:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e85f556850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b38d1ba0-13da-4ef7-a48d-bd7b24ab8218+11:13890:x1874622505136384:12345-192.168.201.9@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787779781.003899:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e85f556850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b38d1ba0-13da-4ef7-a48d-bd7b24ab8218+11:13890:x1874622505136384:12345-192.168.201.9@tcp:503:mount.lustre.0 Request processed in 292us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779781.003907:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 93 00000100:00100000:2.0:1787779781.039309:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779781.039589:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505136512 00000100:00100000:3.0:1787779781.039600:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505136512 00000100:00100000:3.0:1787779781.040124:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 94 00000100:00100000:3.0:1787779781.040146:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ed2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b38d1ba0-13da-4ef7-a48d-bd7b24ab8218+11:13896:x1874622505136512:12345-192.168.201.9@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787779781.040453:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ed2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b38d1ba0-13da-4ef7-a48d-bd7b24ab8218+11:13896:x1874622505136512:12345-192.168.201.9@tcp:502:llog_process_th.0 Request processed in 318us (1151us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779781.040463:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 94 00000100:00100000:0.0:1787779781.068278:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779781.068476:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505136640 00000100:00100000:2.0:1787779781.068487:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505136640 00000100:00100000:2.0:1787779781.068547:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 95 00000100:00100000:2.0:1787779781.068582:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ed2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b38d1ba0-13da-4ef7-a48d-bd7b24ab8218+11:13896:x1874622505136640:12345-192.168.201.9@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787779781.068909:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ed2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b38d1ba0-13da-4ef7-a48d-bd7b24ab8218+11:13896:x1874622505136640:12345-192.168.201.9@tcp:502:llog_process_th.0 Request processed in 338us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779781.068917:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 95 00000100:00100000:1.0:1787779781.078387:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779781.078636:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505136768 00000100:00100000:3.0:1787779781.078644:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505136768 00000100:00100000:3.0:1787779781.078699:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 96 00000100:00100000:3.0:1787779781.078708:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ed2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b38d1ba0-13da-4ef7-a48d-bd7b24ab8218+11:13890:x1874622505136768:12345-192.168.201.9@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787779781.078764:0:14301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779781.078782:0:14301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e8429d5000/0x9e63ba8af688a36b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedb08c expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779781.078828:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e8429d5000/0x9e63ba8af688a36b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb08c expref: 12 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779781.078839:0:14301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e8429d5000/0x9e63ba8af688a36b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb08c expref: 12 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779781.078848:0:14301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e8429d5000, rc 0) 00000100:00100000:3.0:1787779781.078899:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ed2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b38d1ba0-13da-4ef7-a48d-bd7b24ab8218+12:13890:x1874622505136768:12345-192.168.201.9@tcp:101:mount.lustre.0 Request processed in 192us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779781.078905:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 96 00000100:00100000:1.0:1787779781.096464:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779781.096564:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505136896 00000100:00100000:0.0:1787779781.096575:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505136896 00000100:00100000:0.0:1787779781.096645:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 97 00000100:00100000:0.0:1787779781.096655:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ed2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b38d1ba0-13da-4ef7-a48d-bd7b24ab8218+12:13890:x1874622505136896:12345-192.168.201.9@tcp:256:mount.lustre.0 20000000:01000000:0.0:1787779781.096680:0:14303:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787779781.096704:0:14303:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787779781.096709:0:14303:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787779781.096758:0:14303:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787779781.096761:0:14303:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00010000:00010000:0.0:1787779781.108751:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787779781.111342:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ed2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b38d1ba0-13da-4ef7-a48d-bd7b24ab8218+12:13890:x1874622505136896:12345-192.168.201.9@tcp:256:mount.lustre.0 Request processed in 14676us (14877us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779781.111358:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 97 00000100:00100000:1.0:1787779781.119810:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779781.120454:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505137024 00000100:00100000:2.0:1787779781.120467:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505137024 00000100:00100000:2.0:1787779781.120532:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 98 00000100:00100000:2.0:1787779781.120543:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ed2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b38d1ba0-13da-4ef7-a48d-bd7b24ab8218+12:13890:x1874622505137024:12345-192.168.201.9@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787779781.120562:0:14304:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779781.120580:0:14304:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e7430d3200/0x9e63ba8af688a372 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedb093 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779781.120607:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e7430d3200/0x9e63ba8af688a372 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb093 expref: 13 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779781.120619:0:14304:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e7430d3200/0x9e63ba8af688a372 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb093 expref: 13 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779781.120628:0:14304:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e7430d3200, rc 0) 00000100:00100000:2.0:1787779781.120693:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ed2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b38d1ba0-13da-4ef7-a48d-bd7b24ab8218+13:13890:x1874622505137024:12345-192.168.201.9@tcp:101:mount.lustre.0 Request processed in 152us (916us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779781.120700:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 98 00000100:00100000:1.0:1787779781.126198:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779781.126340:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505137152 00000100:00100000:2.0:1787779781.126349:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505137152 00000100:00100000:2.0:1787779781.126425:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 99 00000100:00100000:2.0:1787779781.126435:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ed2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b38d1ba0-13da-4ef7-a48d-bd7b24ab8218+13:13890:x1874622505137152:12345-192.168.201.9@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787779781.127408:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ed2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b38d1ba0-13da-4ef7-a48d-bd7b24ab8218+13:13890:x1874622505137152:12345-192.168.201.9@tcp:501:mount.lustre.0 Request processed in 970us (1216us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779781.127419:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 99 00000100:00100000:0.0:1787779781.131154:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779781.131271:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505137280 00000100:00100000:3.0:1787779781.131283:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505137280 00000100:00100000:3.0:1787779781.131379:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 100 00000100:00100000:3.0:1787779781.131425:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ed2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b38d1ba0-13da-4ef7-a48d-bd7b24ab8218+13:13890:x1874622505137280:12345-192.168.201.9@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787779781.131661:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ed2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b38d1ba0-13da-4ef7-a48d-bd7b24ab8218+13:13890:x1874622505137280:12345-192.168.201.9@tcp:503:mount.lustre.0 Request processed in 273us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779781.131670:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 100 00000100:00100000:1.0:1787779781.136495:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779781.136629:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505137408 00000100:00100000:2.0:1787779781.136641:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505137408 00000100:00100000:2.0:1787779781.136707:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 101 00000100:00100000:2.0:1787779781.136744:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ed2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b38d1ba0-13da-4ef7-a48d-bd7b24ab8218+13:13900:x1874622505137408:12345-192.168.201.9@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787779781.137094:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ed2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b38d1ba0-13da-4ef7-a48d-bd7b24ab8218+13:13900:x1874622505137408:12345-192.168.201.9@tcp:502:llog_process_th.0 Request processed in 353us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779781.137102:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 101 00000100:00100000:1.0:1787779781.151532:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779781.151613:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505137536 00000100:00100000:3.0:1787779781.151625:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505137536 00000100:00100000:3.0:1787779781.151681:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 102 00000100:00100000:3.0:1787779781.151692:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ed2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b38d1ba0-13da-4ef7-a48d-bd7b24ab8218+13:13900:x1874622505137536:12345-192.168.201.9@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787779781.152286:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ed2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b38d1ba0-13da-4ef7-a48d-bd7b24ab8218+13:13900:x1874622505137536:12345-192.168.201.9@tcp:502:llog_process_th.0 Request processed in 593us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779781.152295:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 102 00000100:00100000:1.0:1787779781.167189:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779781.167220:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779781.167273:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779781.167304:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779781.167336:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505138048 00000100:00100000:1.0:1787779781.167346:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505138048 00000100:00100000:1.0:1787779781.167392:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505137664 00000100:00100000:1.0:1787779781.167395:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505137664 00000100:00100000:1.0:1787779781.167409:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 16 00000100:00100000:1.0:1787779781.167417:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e852b9e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:43b382b8-5aec-409a-8dc5-84d259a200e7+7:2357:x1874622505138048:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:1.0:1787779781.167492:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e852b9e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:43b382b8-5aec-409a-8dc5-84d259a200e7+7:2357:x1874622505138048:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 76us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779781.167499:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 16 00000100:00100000:3.0:1787779781.167648:0:14994:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505138176 00000100:00100000:3.0:1787779781.167658:0:14994:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505138176 00000100:00100000:3.0:1787779781.167687:0:14994:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505138304 00000100:00100000:3.0:1787779781.167689:0:14994:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505138304 00000100:00100000:3.0:1787779781.167704:0:14994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 3 00000100:00100000:3.0:1787779781.167780:0:14994:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e852b9d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:43b382b8-5aec-409a-8dc5-84d259a200e7+6:2357:x1874622505138176:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:3.0:1787779781.167810:0:14994:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e852b9d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:43b382b8-5aec-409a-8dc5-84d259a200e7+6:2357:x1874622505138176:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 100us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779781.167817:0:14994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 3 00000100:00100000:3.0:1787779781.167831:0:14994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 4 00000100:00100000:3.0:1787779781.167851:0:14994:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e852b9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:43b382b8-5aec-409a-8dc5-84d259a200e7+6:2357:x1874622505138304:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:3.0:1787779781.167873:0:14994:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e852b9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:43b382b8-5aec-409a-8dc5-84d259a200e7+6:2357:x1874622505138304:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 37us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779781.167879:0:14994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 4 00000100:00100000:1.0:1787779781.168041:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 10 00000100:00100000:1.0:1787779781.168049:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e852b9f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2356:x1874622505137664:12345-192.168.201.9@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787779781.168073:0:14309:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 9f07da6d-bdd3-44fa-ab17-edf321a3c5bb@192.168.201.9@tcp t0 exp 0000000000000000 cur 546 last 0 00000020:00000080:1.0:1787779781.168114:0:14309:0:(genops.c:1385:class_connect()) connect: client 9f07da6d-bdd3-44fa-ab17-edf321a3c5bb, cookie 0x9e63ba8af688a379 00000004:00100000:1.0:1787779781.168156:0:14309:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787779781.168276:0:14309:0:(import.c:65:import_set_state_nolock()) ffff98e874589000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787779781.168308:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e852b9f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9f07da6d-bdd3-44fa-ab17-edf321a3c5bb+6:2356:x1874622505137664:12345-192.168.201.9@tcp:38:mount.lustre.0 Request processed in 259us (1003us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779781.175862:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779781.176115:0:14311:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787779781.176126:0:14311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1787779781.176730:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505137920 00000100:00100000:0.0:1787779781.176741:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505137920 00000100:00080000:2.0:1787779781.177100:0:14305:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787779781.177424:0:16187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 11 00000100:00100000:3.0:1787779781.177436:0:16187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec9f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9f07da6d-bdd3-44fa-ab17-edf321a3c5bb+7:13890:x1874622505137920:12345-192.168.201.9@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787779781.177465:0:16187:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787779781.177558:0:16187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec9f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9f07da6d-bdd3-44fa-ab17-edf321a3c5bb+7:13890:x1874622505137920:12345-192.168.201.9@tcp:41:mount.lustre.0 Request processed in 124us (1715us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779781.177566:0:16187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 11 00000100:00100000:2.0:1787779781.177810:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779781.179675:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505137792 00000100:00100000:3.0:1787779781.179686:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505137792 00000100:00100000:2.0:1787779781.179816:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 12 00000100:00100000:2.0:1787779781.179825:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f6b52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9f07da6d-bdd3-44fa-ab17-edf321a3c5bb+7:0:x1874622505137792:12345-192.168.201.9@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787779781.180074:0:14311:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787779781.180145:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f6b52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9f07da6d-bdd3-44fa-ab17-edf321a3c5bb+7:0:x1874622505137792:12345-192.168.201.9@tcp:41:mount.lustre.0 Request processed in 320us (2335us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779781.180152:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 12 00000100:00100000:1.0:1787779781.180217:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 10 00000100:00100000:2.0:1787779781.181125:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779781.181197:0:16187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505138432 00000100:00100000:3.0:1787779781.181203:0:16187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505138432 00000100:00100000:3.0:1787779781.181244:0:16187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 13 00000100:00100000:3.0:1787779781.181251:0:16187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f6b6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9f07da6d-bdd3-44fa-ab17-edf321a3c5bb+6:13890:x1874622505138432:12345-192.168.201.9@tcp:40:mount.lustre.0 00000100:00100000:3.0:1787779781.181322:0:16187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f6b6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9f07da6d-bdd3-44fa-ab17-edf321a3c5bb+6:13890:x1874622505138432:12345-192.168.201.9@tcp:40:mount.lustre.0 Request processed in 71us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779781.181329:0:16187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 13 00000100:00100000:1.0:1787779781.190326:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779781.190363:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779781.190393:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779781.190468:0:14994:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505138560 00000100:00100000:2.0:1787779781.190478:0:14994:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505138560 00000100:00100000:2.0:1787779781.190526:0:14994:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505138688 00000100:00100000:2.0:1787779781.190530:0:14994:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505138688 00000100:00100000:2.0:1787779781.190544:0:14994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 10 00000100:00100000:2.0:1787779781.190566:0:14994:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e852b9c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2356:x1874622505138560:12345-192.168.201.9@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787779781.190598:0:14994:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 9f07da6d-bdd3-44fa-ab17-edf321a3c5bb@192.168.201.9@tcp t0 exp 0000000000000000 cur 546 last 0 00000020:00000080:2.0:1787779781.190629:0:14994:0:(genops.c:1385:class_connect()) connect: client 9f07da6d-bdd3-44fa-ab17-edf321a3c5bb, cookie 0x9e63ba8af688a380 00002000:00100000:2.0:1787779781.190642:0:14994:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 9f07da6d-bdd3-44fa-ab17-edf321a3c5bb/ffff98e87a9f0800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113939 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787779781.190651:0:14994:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787779781.190994:0:14994:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787779781.191026:0:14994:0:(import.c:65:import_set_state_nolock()) ffff98e87a9f7800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787779781.191269:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505138816 00000100:00100000:3.0:1787779781.191274:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505138816 00000100:00100000:3.0:1787779781.191314:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 1 00000100:00100000:3.0:1787779781.191322:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e852b9cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9f07da6d-bdd3-44fa-ab17-edf321a3c5bb+6:13890:x1874622505138816:12345-192.168.201.9@tcp:33:mount.lustre.0 00000100:00100000:2.0:1787779781.192004:0:14994:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e852b9c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9f07da6d-bdd3-44fa-ab17-edf321a3c5bb+6:2356:x1874622505138560:12345-192.168.201.9@tcp:8:mount.lustre.0 Request processed in 1436us (1637us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779781.192014:0:14994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 10 00000100:00100000:2.0:1787779781.192034:0:14994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 11 00000100:00100000:2.0:1787779781.192039:0:14994:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e852b9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2356:x1874622505138688:12345-192.168.201.9@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787779781.192060:0:14994:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 9f07da6d-bdd3-44fa-ab17-edf321a3c5bb@192.168.201.9@tcp t0 exp 0000000000000000 cur 546 last 0 00000004:00200000:3.0:1787779781.192484:0:14313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000020:00000080:2.0:1787779781.193063:0:14994:0:(genops.c:1385:class_connect()) connect: client 9f07da6d-bdd3-44fa-ab17-edf321a3c5bb, cookie 0x9e63ba8af688a387 00002000:00100000:2.0:1787779781.193083:0:14994:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 9f07da6d-bdd3-44fa-ab17-edf321a3c5bb/ffff98e87a9f7000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113939 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787779781.193093:0:14994:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787779781.193196:0:14994:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787779781.193226:0:14994:0:(import.c:65:import_set_state_nolock()) ffff98e87a9f2000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787779781.193277:0:14994:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e852b9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9f07da6d-bdd3-44fa-ab17-edf321a3c5bb+6:2356:x1874622505138688:12345-192.168.201.9@tcp:8:mount.lustre.0 Request processed in 1235us (2881us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779781.193284:0:14994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 11 00000100:00100000:3.0:1787779781.194178:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e852b9cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9f07da6d-bdd3-44fa-ab17-edf321a3c5bb+6:13890:x1874622505138816:12345-192.168.201.9@tcp:33:mount.lustre.0 Request processed in 2854us (3859us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779781.194189:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 1 00000100:00100000:1.0:1787779781.393989:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779781.394102:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505138944 00000100:00100000:2.0:1787779781.394114:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505138944 00000100:00100000:2.0:1787779781.394193:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 14 00000100:00100000:2.0:1787779781.394219:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e853585e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9f07da6d-bdd3-44fa-ab17-edf321a3c5bb+6:13922:x1874622505138944:12345-192.168.201.9@tcp:101:mkdir.0 00010000:00010000:2.0:1787779781.394242:0:14311:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779781.394267:0:14311:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d2c00/0x9e63ba8af688a38e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedb0bd expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779781.394338:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d3c00/0x9e63ba8af688a395 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779781.394353:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d3c00/0x9e63ba8af688a395 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779781.394367:0:14311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d3c00/0x9e63ba8af688a395 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787779781.394583:0:14311:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787779781.394588:0:14311:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1787779781.394674:0:14311:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d3c00/0x9e63ba8af688a395 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779781.394703:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d2c00/0x9e63ba8af688a38e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb0bd expref: 8 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779781.394755:0:14311:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d3c00/0x9e63ba8af688a395 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb0bd expref: 7 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779781.394764:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e860e78a00) 00010000:00010000:2.0:1787779781.394766:0:14311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787779781.394770:0:14311:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e7430d3c00, rc 0) 00000100:00100000:2.0:1787779781.395563:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e853585e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9f07da6d-bdd3-44fa-ab17-edf321a3c5bb+7:13922:x1874622505138944:12345-192.168.201.9@tcp:101:mkdir.0 Request processed in 1343us (1580us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779781.395584:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 14 00010000:00010000:2.0:1787779782.130891:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787779782.580786:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f6b7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622525056512:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787779782.580855:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779782.581019:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87fdd1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874622525056768:0@lo:400:kworker.0 00000100:00100000:0.0:1787779782.581050:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779782.581100:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525056768 00000100:00100000:0.0:1787779782.581115:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525056768 00000100:00100000:0.0:1787779782.581182:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787779782.581192:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87fdd12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874622525056768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779782.581249:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87fdd12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874622525056768:12345-0@lo:400:kworker.0 Request processed in 59us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779782.581256:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1787779782.581278:0:14305:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787779782.581306:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87fdd1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874622525056768:0@lo:400:kworker.0 00000100:00100000:0.0:1787779782.581344:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87fdd1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874622525056896:0@lo:400:kworker.0 00000100:00100000:0.0:1787779782.581371:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779782.581641:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87fdd1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874622525057024:0@lo:400:kworker.0 00000100:00100000:2.0:1787779782.581670:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779782.581699:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787779782.581706:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87fdd03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:3306:1874622525056640:0@lo:400:kworker.0 00000100:00100000:2.0:1787779782.581758:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779782.581780:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87fdd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1874622525057152:0@lo:400:kworker.0 00000100:00100000:2.0:1787779782.581800:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779782.581892:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525056896 00000100:00100000:0.0:1787779782.581898:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525056896 00000100:00100000:0.0:1787779782.581926:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525057024 00000100:00100000:0.0:1787779782.581929:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525057024 00000100:00100000:0.0:1787779782.581947:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525057152 00000100:00100000:0.0:1787779782.581949:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525057152 00000100:00100000:0.0:1787779782.581963:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787779782.581970:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87fdd0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874622525056896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779782.582029:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87fdd0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874622525056896:12345-0@lo:400:kworker.0 Request processed in 59us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779782.582035:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787779782.582062:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787779782.582068:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f6b6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874622525057024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779782.582102:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f6b6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874622525057024:12345-0@lo:400:kworker.0 Request processed in 35us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779782.582116:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787779782.582129:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787779782.582135:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f6b5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874622525057152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779782.582176:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f6b5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874622525057152:12345-0@lo:400:kworker.0 Request processed in 42us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779782.582182:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787779782.582199:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525056640 00000100:00100000:0.0:1787779782.582202:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525056640 00000100:00100000:0.0:1787779782.582224:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787779782.582230:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ed2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+19:3306:x1874622525056640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779782.582258:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ed2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+19:3306:x1874622525056640:12345-0@lo:400:kworker.0 Request processed in 29us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779782.582264:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:0.0:1787779782.582290:0:14305:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787779782.582313:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87fdd1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874622525056896:0@lo:400:kworker.0 00000100:00100000:0.0:1787779782.582336:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87fdd03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:3306:1874622525056640:0@lo:400:kworker.0 00000100:00100000:0.0:1787779782.582345:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87fdd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1874622525057152:0@lo:400:kworker.0 00000100:00100000:0.0:1787779782.582364:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87fdd1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874622525057024:0@lo:400:kworker.0 00000100:00100000:1.0:1787779782.584333:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525056512 00000100:00100000:1.0:1787779782.584347:0:14996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525056512 00000100:00100000:1.0:1787779782.584471:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787779782.584495:0:14996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f6b4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622525056512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787779782.584534:0:14996:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787779782.584612:0:14996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f6b4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622525056512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (3756us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779782.584620:0:14996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787779782.592178:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1787779782.592217:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f6b7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622525056512:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1787779782.599556:0:14305:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:3.0:1787779782.673037:0:7634:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 43b382b8-5aec-409a-8dc5-84d259a200e7 00000001:00100000:3.0:1787779782.673064:0:7634:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9f07da6d-bdd3-44fa-ab17-edf321a3c5bb 00000001:00100000:3.0:1787779782.677519:0:6704:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 43b382b8-5aec-409a-8dc5-84d259a200e7 00000001:00100000:3.0:1787779782.677533:0:6704:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9f07da6d-bdd3-44fa-ab17-edf321a3c5bb 00010000:00010000:0.0:1787779783.154905:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779783.603112:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787779783.603136:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87fdd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874622525057280:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787779783.603211:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779783.603480:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525057280 00000100:00100000:1.0:1787779783.603489:0:14996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525057280 00000100:00100000:1.0:1787779783.603543:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787779783.603552:0:14996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87fdd03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874622525057280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787779783.603586:0:14996:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787779783.603679:0:14996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87fdd03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874622525057280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779783.603687:0:14996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787779783.609227:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87fdd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874622525057280:0@lo:13:osp-pre-0-0.0 00000001:00100000:1.0:1787779783.675156:0:5857:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 43b382b8-5aec-409a-8dc5-84d259a200e7 00000001:00100000:1.0:1787779783.675172:0:5857:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 9f07da6d-bdd3-44fa-ab17-edf321a3c5bb 00010000:00010000:2.0:1787779784.190149:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787779785.203424:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787779785.268116:0:16278:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1787779786.227108:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779786.412400:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779786.412445:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779786.412480:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779786.412513:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779786.412535:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779786.412560:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779786.412587:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505139328 00000100:00100000:1.0:1787779786.412588:0:14994:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505139456 00000100:00100000:1.0:1787779786.412597:0:14994:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505139456 00000100:00100000:0.0:1787779786.412597:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505139328 00000100:00100000:1.0:1787779786.412652:0:14994:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505139712 00000100:00100000:3.0:1787779786.412654:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505139072 00000100:00100000:1.0:1787779786.412655:0:14994:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505139712 00000100:00100000:3.0:1787779786.412656:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505139072 00000100:00100000:3.0:1787779786.412696:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 104 00000100:00100000:3.0:1787779786.412706:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ed2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b38d1ba0-13da-4ef7-a48d-bd7b24ab8218+13:2360:x1874622505139072:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:2.0:1787779786.412707:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505139200 00000100:00100000:2.0:1787779786.412732:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505139200 00000100:00100000:3.0:1787779786.412803:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ed2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b38d1ba0-13da-4ef7-a48d-bd7b24ab8218+13:2360:x1874622505139072:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 98us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779786.412811:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 104 00000100:00100000:0.0:1787779786.417347:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 6 00000100:00100000:0.0:1787779786.417368:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87fdd1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:43b382b8-5aec-409a-8dc5-84d259a200e7+5:2359:x1874622505139456:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:0.0:1787779786.417454:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87fdd1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:43b382b8-5aec-409a-8dc5-84d259a200e7+5:2359:x1874622505139456:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 96us (4940us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779786.417462:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 6 00000100:00100000:0.0:1787779786.417482:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 7 00000100:00100000:0.0:1787779786.417489:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87fdd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:43b382b8-5aec-409a-8dc5-84d259a200e7+5:2359:x1874622505139328:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:0.0:1787779786.417515:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87fdd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:43b382b8-5aec-409a-8dc5-84d259a200e7+5:2359:x1874622505139328:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 27us (5035us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779786.417539:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 7 00000100:00100000:3.0:1787779786.420481:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779786.420519:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505139840 00000100:00100000:3.0:1787779786.420530:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505139840 00000100:00100000:3.0:1787779786.420586:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 8 00000100:00100000:3.0:1787779786.420597:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec9e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9f07da6d-bdd3-44fa-ab17-edf321a3c5bb+5:2359:x1874622505139840:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:3.0:1787779786.420665:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec9e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9f07da6d-bdd3-44fa-ab17-edf321a3c5bb+5:2359:x1874622505139840:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 69us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779786.420673:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 8 00000100:00100000:0.0:1787779786.421553:0:14994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 9 00000100:00100000:0.0:1787779786.421566:0:14994:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87fdd3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9f07da6d-bdd3-44fa-ab17-edf321a3c5bb+5:2359:x1874622505139712:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:0.0:1787779786.421629:0:14994:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87fdd3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9f07da6d-bdd3-44fa-ab17-edf321a3c5bb+5:2359:x1874622505139712:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 67us (9068us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779786.421636:0:14994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 9 00000100:00100000:2.0:1787779786.422385:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505139584 00000100:00100000:2.0:1787779786.422404:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505139584 00000100:00100000:1.0:1787779786.423161:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 20 00000100:00100000:1.0:1787779786.423177:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87fdd1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:43b382b8-5aec-409a-8dc5-84d259a200e7+6:2359:x1874622505139200:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:1.0:1787779786.423255:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87fdd1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:43b382b8-5aec-409a-8dc5-84d259a200e7+6:2359:x1874622505139200:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 84us (10809us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779786.423263:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 20 00000100:00100000:1.0:1787779786.423377:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 21 00000100:00100000:1.0:1787779786.423385:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87fdd1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9f07da6d-bdd3-44fa-ab17-edf321a3c5bb+6:2359:x1874622505139584:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:1.0:1787779786.423480:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87fdd1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9f07da6d-bdd3-44fa-ab17-edf321a3c5bb+6:2359:x1874622505139584:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 97us (10944us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779786.423488:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 21 00000100:00080000:1.0:1787779786.423923:0:14305:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787779786.423930:0:14305:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787779786.423941:0:14305:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787779787.259943:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779787.700189:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87a70a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622525057536:0@lo:400:kworker.0 00000100:00100000:0.0:1787779787.700269:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779787.700325:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87a70a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1874622525058048:0@lo:400:kworker.0 00000100:00100000:0.0:1787779787.700349:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779787.700377:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787779787.700382:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87a70b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622525057664:0@lo:400:kworker.0 00000100:00100000:0.0:1787779787.700403:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779787.700435:0:14993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525057536 00000100:00100000:0.0:1787779787.700441:0:14993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525057536 00000100:00100000:0.0:1787779787.700496:0:14993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525057664 00000100:00100000:0.0:1787779787.700500:0:14993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525057664 00000100:00100000:0.0:1787779787.700520:0:14993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787779787.700528:0:14993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a708f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622525057536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779787.700580:0:14993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a708f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622525057536:12345-0@lo:400:kworker.0 Request processed in 53us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779787.700587:0:14993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787779787.700606:0:14993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787779787.700613:0:14993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a70bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622525057664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779787.700656:0:14993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a70bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622525057664:12345-0@lo:400:kworker.0 Request processed in 44us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779787.700662:0:14993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787779787.700682:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525058048 00000100:00100000:0.0:1787779787.700686:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525058048 00000100:00100000:0.0:1787779787.700741:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787779787.700749:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a70b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874622525058048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779787.700781:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a70b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874622525058048:12345-0@lo:400:kworker.0 Request processed in 34us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779787.700787:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787779787.700831:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87a70b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622525057664:0@lo:400:kworker.0 00000100:00100000:0.0:1787779787.700842:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87a70a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622525057536:0@lo:400:kworker.0 00000100:00100000:0.0:1787779787.700851:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87a70a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1874622525058048:0@lo:400:kworker.0 00000100:00100000:0.0:1787779787.701148:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787779787.701157:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f6b4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622525058176:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787779787.701186:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779787.701308:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e852b9f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:3305:1874622525057408:0@lo:400:kworker.0 00000100:00100000:3.0:1787779787.701344:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779787.701372:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87a70ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1874622525057920:0@lo:400:kworker.0 00000100:00100000:3.0:1787779787.701394:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779787.701414:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787779787.701420:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87a708000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874622525057792:0@lo:400:kworker.0 00000100:00100000:3.0:1787779787.701439:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779787.701492:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525057408 00000100:00100000:3.0:1787779787.701497:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525057408 00000100:00100000:3.0:1787779787.701526:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787779787.701532:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+19:3305:x1874622525057408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779787.701567:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+19:3305:x1874622525057408:12345-0@lo:400:kworker.0 Request processed in 35us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779787.701573:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787779787.701601:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525057920 00000100:00100000:3.0:1787779787.701605:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525057920 00000100:00100000:3.0:1787779787.701630:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525057792 00000100:00100000:3.0:1787779787.701633:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525057792 00000100:00100000:3.0:1787779787.701651:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787779787.701670:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec9cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874622525057920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779787.701701:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec9cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874622525057920:12345-0@lo:400:kworker.0 Request processed in 33us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779787.701707:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787779787.701744:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787779787.701750:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874622525057792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779787.701777:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874622525057792:12345-0@lo:400:kworker.0 Request processed in 28us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779787.701783:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787779787.702762:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525058176 00000100:00100000:2.0:1787779787.702774:0:14996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525058176 00000100:00100000:2.0:1787779787.702822:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787779787.702830:0:14996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a70a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622525058176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787779787.702864:0:14996:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787779787.702933:0:14996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a70a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622525058176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (1745us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779787.702939:0:14996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787779787.703029:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f6b4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622525058176:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787779787.704498:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87a708000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874622525057792:0@lo:400:kworker.0 00000100:00100000:3.0:1787779787.704515:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e852b9f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:3305:1874622525057408:0@lo:400:kworker.0 00000100:00100000:3.0:1787779787.704527:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87a70ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1874622525057920:0@lo:400:kworker.0 00000100:00080000:1.0:1787779787.704815:0:14305:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787779787.704822:0:14305:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787779787.704825:0:14305:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787779788.281098:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779788.723523:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f6b7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874622525058304:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787779788.723607:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779788.723689:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525058304 00000100:00100000:3.0:1787779788.723696:0:14996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525058304 00000100:00100000:3.0:1787779788.723767:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787779788.723776:0:14996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec9da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874622525058304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787779788.723813:0:14996:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787779788.723859:0:14996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec9da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874622525058304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779788.723866:0:14996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787779788.723918:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f6b7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874622525058304:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787779789.299633:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787779789.441566:0:16427:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe8167ade0 20000000:00000080:0.0:1787779789.441585:0:16427:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98e87e23a000 uarg=0000000000000000 20000000:01000000:0.0:1787779789.441628:0:16427:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787779789.441635:0:16427:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787779789.441640:0:16427:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1787779789.443043:0:16428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:3.0:1787779789.443248:0:16427:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1787779789.448433:0:16427:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787779789.448561:0:16427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98e848f69600/0x9e63ba8af688a39c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779789.448586:0:16427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98e848f69e00/0x9e63ba8af688a093 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af688a08c expref: 18 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779789.448609:0:16427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98e87a98b600/0x9e63ba8af688a0e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af688a0d9 expref: 18 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779789.448617:0:16427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98e8429d4200/0x9e63ba8af688a214 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af688a20d expref: 18 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779789.448627:0:16427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98e7430d2400/0x9e63ba8af688a33a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb031 expref: 12 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779789.448635:0:16427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98e7430d3200/0x9e63ba8af688a372 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb093 expref: 12 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779789.448643:0:16427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98e848f69600/0x9e63ba8af688a39c lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779789.448694:0:16427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98e7430d3200/0x9e63ba8af688a372 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb093 expref: 12 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779789.449365:0:16427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98e7430d3200/0x9e63ba8af688a372 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb093 expref: 12 pid: 14304 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779789.449383:0:16427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87a70a940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16427:1874622525058432:192.168.201.9@tcp:104: 00010000:00010000:0.0:1787779789.449541:0:16427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98e7430d2400/0x9e63ba8af688a33a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb031 expref: 12 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779789.449551:0:16427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98e7430d2400/0x9e63ba8af688a33a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb031 expref: 12 pid: 14304 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779789.449560:0:16427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87a70b0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16427:1874622525058560:192.168.201.9@tcp:104: 00010000:00010000:0.0:1787779789.449603:0:16427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98e8429d4200/0x9e63ba8af688a214 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9e63ba8af688a20d expref: 18 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779789.449612:0:16427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98e8429d4200/0x9e63ba8af688a214 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9e63ba8af688a20d expref: 18 pid: 14304 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779789.449622:0:16427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87a709a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16427:1874622525058688:0@lo:104: 00000100:00100000:0.0:1787779789.449665:0:16427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787779789.449728:0:16427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98e87a98b600/0x9e63ba8af688a0e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9e63ba8af688a0d9 expref: 18 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779789.449738:0:16427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98e87a98b600/0x9e63ba8af688a0e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9e63ba8af688a0d9 expref: 18 pid: 14304 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779789.449747:0:16427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87a7083c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16427:1874622525058816:0@lo:104: 00000100:00100000:0.0:1787779789.449769:0:16427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787779789.449812:0:16427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98e848f69e00/0x9e63ba8af688a093 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9e63ba8af688a08c expref: 18 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779789.449820:0:16427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98e848f69e00/0x9e63ba8af688a093 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9e63ba8af688a08c expref: 18 pid: 14303 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779789.449828:0:16427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87a709680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16427:1874622525058944:0@lo:104: 00000100:00100000:0.0:1787779789.449852:0:16427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779789.449863:0:16427:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e85ff2ea80 going to sleep for 11 seconds 00000100:00100000:1.0:1787779789.449945:0:14293:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787779789.449960:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525058688 00000100:00100000:1.0:1787779789.449965:0:14293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525058688 00000100:00100000:1.0:1787779789.450016:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525058816 00000100:00100000:1.0:1787779789.450019:0:14293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525058816 00000100:00100000:1.0:1787779789.450029:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525058944 00000100:00100000:1.0:1787779789.450032:0:14293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525058944 00000100:00100000:1.0:1787779789.450043:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787779789.450052:0:14293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a70a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+5:16427:x1874622525058688:12345-0@lo:104: 00010000:00010000:1.0:1787779789.450065:0:14293:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.109@tcp lock: ffff98e87a94f000/0x9e63ba8af688a20d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9e63ba8af688a214 expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779789.450125:0:14293:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787779789.450132:0:14293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a70a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+5:16427:x1874622525058688:12345-0@lo:104: Request processed in 81us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779789.450139:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787779789.450155:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787779789.450161:0:14293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a708b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+4:16427:x1874622525058816:12345-0@lo:104: 00010000:00010000:1.0:1787779789.450169:0:14293:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.109@tcp lock: ffff98e8429d5600/0x9e63ba8af688a0d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9e63ba8af688a0e0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779789.450208:0:14293:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787779789.450214:0:14293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a708b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+4:16427:x1874622525058816:12345-0@lo:104: Request processed in 53us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779789.450220:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787779789.450245:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787779789.450252:0:14293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e848f62450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+3:16427:x1874622525058944:12345-0@lo:104: 00010000:00010000:1.0:1787779789.450259:0:14293:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.109@tcp lock: ffff98e8429d4a00/0x9e63ba8af688a08c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9e63ba8af688a093 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779789.450285:0:14293:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787779789.450290:0:14293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e848f62450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+3:16427:x1874622525058944:12345-0@lo:104: Request processed in 39us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779789.450295:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1787779789.450334:0:14297:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787779789.450340:0:14297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff98e87a94f000/0x9e63ba8af688a20d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9e63ba8af688a214 expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779789.450347:0:14297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87a94f000 already unused, calling callback (ffffffffc1cd5c20) 10000000:00010000:1.0:1787779789.450351:0:14297:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff98e87a94f000/0x9e63ba8af688a20d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9e63ba8af688a214 expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779789.450359:0:14297:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff98e87a94f000/0x9e63ba8af688a20d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9e63ba8af688a214 expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787779789.450366:0:14297:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff98e87a94f000/0x9e63ba8af688a20d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9e63ba8af688a214 expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787779789.450372:0:14297:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787779789.450408:0:14297:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.109@tcp lock: ffff98e87a94f000/0x9e63ba8af688a20d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af688a214 expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779789.450414:0:14297:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787779789.450436:0:14297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff98e87a94f000/0x9e63ba8af688a20d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af688a214 expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779789.450443:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff98e87a94f000/0x9e63ba8af688a20d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af688a214 expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779789.450455:0:14297:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787779789.450458:0:14297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff98e8429d5600/0x9e63ba8af688a0d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9e63ba8af688a0e0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779789.450464:0:14297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e8429d5600 already unused, calling callback (ffffffffc1cd5c20) 10000000:00010000:1.0:1787779789.450467:0:14297:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff98e8429d5600/0x9e63ba8af688a0d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9e63ba8af688a0e0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779789.450473:0:14297:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff98e8429d5600/0x9e63ba8af688a0d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9e63ba8af688a0e0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787779789.450479:0:14297:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff98e8429d5600/0x9e63ba8af688a0d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9e63ba8af688a0e0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787779789.450483:0:14297:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787779789.450496:0:14297:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.109@tcp lock: ffff98e8429d5600/0x9e63ba8af688a0d9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af688a0e0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779789.450502:0:14297:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787779789.450516:0:14297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff98e8429d5600/0x9e63ba8af688a0d9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af688a0e0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779789.450533:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff98e8429d5600/0x9e63ba8af688a0d9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af688a0e0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779789.450543:0:14297:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787779789.450545:0:14297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.109@tcp lock: ffff98e8429d4a00/0x9e63ba8af688a08c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9e63ba8af688a093 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779789.450550:0:14297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e8429d4a00 already unused, calling callback (ffffffffc1cd5c20) 10000000:00010000:1.0:1787779789.450552:0:14297:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.109@tcp lock: ffff98e8429d4a00/0x9e63ba8af688a08c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9e63ba8af688a093 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779789.450558:0:14297:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.109@tcp lock: ffff98e8429d4a00/0x9e63ba8af688a08c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9e63ba8af688a093 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787779789.450563:0:14297:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.109@tcp lock: ffff98e8429d4a00/0x9e63ba8af688a08c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9e63ba8af688a093 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787779789.450568:0:14297:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787779789.450580:0:14297:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.109@tcp lock: ffff98e8429d4a00/0x9e63ba8af688a08c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af688a093 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779789.450586:0:14297:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787779789.450592:0:14297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.109@tcp lock: ffff98e8429d4a00/0x9e63ba8af688a08c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af688a093 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779789.450597:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.109@tcp lock: ffff98e8429d4a00/0x9e63ba8af688a08c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9e63ba8af688a093 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779789.450612:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779789.450619:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779789.450620:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779789.450626:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779789.450646:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ece4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:3305:1874622525059072:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787779789.450676:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779789.450742:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ece5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:3306:1874622525059200:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787779789.450766:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779789.450787:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787779789.450793:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ece52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:3306:1874622525059328:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787779789.450815:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779789.450845:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525059072 00000100:00100000:1.0:1787779789.450849:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525059072 00010000:00010000:1.0:1787779789.450869:0:14296:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98e8429d4200/0x9e63ba8af688a214 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9e63ba8af688a20d expref: 19 pid: 14304 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779789.450884:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525059200 00000100:00100000:1.0:1787779789.450887:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525059200 00010000:00010000:1.0:1787779789.450899:0:14296:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98e87a98b600/0x9e63ba8af688a0e0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9e63ba8af688a0d9 expref: 20 pid: 14304 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779789.450909:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525059328 00000100:00100000:1.0:1787779789.450912:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525059328 00010000:00010000:1.0:1787779789.450922:0:14296:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98e848f69e00/0x9e63ba8af688a093 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9e63ba8af688a08c expref: 21 pid: 14303 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779789.450934:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787779789.450940:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ece5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+21:3305:x1874622525059072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787779789.450950:0:14296:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787779789.450956:0:14296:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98e8429d4200/0x9e63ba8af688a214 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9e63ba8af688a20d expref: 21 pid: 14304 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779789.450971:0:14296:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98e8429d4200/0x9e63ba8af688a214 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9e63ba8af688a20d expref: 21 pid: 14304 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779789.450999:0:14296:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787779789.451029:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ece5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+21:3305:x1874622525059072:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779789.451037:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787779789.451051:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787779789.451056:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ece5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+20:3306:x1874622525059200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787779789.451063:0:14296:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787779789.451068:0:14296:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98e87a98b600/0x9e63ba8af688a0e0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9e63ba8af688a0d9 expref: 20 pid: 14304 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779789.451076:0:14296:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98e87a98b600/0x9e63ba8af688a0e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9e63ba8af688a0d9 expref: 20 pid: 14304 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779789.451087:0:14296:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787779789.451108:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ece5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+20:3306:x1874622525059200:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779789.451113:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787779789.451124:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787779789.451129:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f02f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+19:3306:x1874622525059328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787779789.451136:0:14296:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787779789.451140:0:14296:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98e848f69e00/0x9e63ba8af688a093 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9e63ba8af688a08c expref: 19 pid: 14303 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779789.451147:0:14296:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98e848f69e00/0x9e63ba8af688a093 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9e63ba8af688a08c expref: 19 pid: 14303 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779789.451163:0:14296:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787779789.451184:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f02f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+19:3306:x1874622525059328:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779789.451191:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787779789.451253:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ece4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:3305:1874622525059072:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787779789.451280:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ece52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:3306:1874622525059328:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787779789.451287:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ece5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:3306:1874622525059200:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787779789.451527:0:16427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e8429d4200/0x9e63ba8af688a214 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9e63ba8af688a20d expref: 18 pid: 14304 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779789.451540:0:16427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87a709a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16427:1874622525058688:0@lo:104: 00010000:00010000:0.0:1787779789.451549:0:16427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e87a98b600/0x9e63ba8af688a0e0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9e63ba8af688a0d9 expref: 17 pid: 14304 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779789.451563:0:16427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87a7083c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16427:1874622525058816:0@lo:104: 00010000:00010000:0.0:1787779789.451574:0:16427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e848f69e00/0x9e63ba8af688a093 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9e63ba8af688a08c expref: 16 pid: 14303 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779789.451581:0:16427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87a709680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16427:1874622525058944:0@lo:104: 00000100:00100000:0.0:1787779789.455837:0:16427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87a70a940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16427:1874622525058432:192.168.201.9@tcp:104: 00000100:00100000:0.0:1787779789.455853:0:16427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87a70b0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16427:1874622525058560:192.168.201.9@tcp:104: 00010000:00010000:0.0:1787779789.455890:0:16427:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98e848f69600/0x9e63ba8af688a39c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779789.458534:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779789.458628:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779789.459067:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505139968 00000100:00100000:1.0:1787779789.459078:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505139968 00000100:00100000:2.0:1787779789.459096:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505140096 00000100:00100000:2.0:1787779789.459100:0:14294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505140096 00010000:00010000:2.0:1787779789.459119:0:14294:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98e7430d2400/0x9e63ba8af688a33a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb031 expref: 14 pid: 14304 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779789.459119:0:14296:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98e7430d3200/0x9e63ba8af688a372 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb093 expref: 14 pid: 14304 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779789.459160:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 7 00000100:00100000:1.0:1787779789.459165:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 8 00000100:00100000:2.0:1787779789.459169:0:14294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec9cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b38d1ba0-13da-4ef7-a48d-bd7b24ab8218+14:2360:x1874622505140096:12345-192.168.201.9@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787779789.459170:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec9c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b38d1ba0-13da-4ef7-a48d-bd7b24ab8218+14:2360:x1874622505139968:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787779789.459182:0:14294:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787779789.459182:0:14296:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787779789.459188:0:14294:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98e7430d2400/0x9e63ba8af688a33a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb031 expref: 14 pid: 14304 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779789.459188:0:14296:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98e7430d3200/0x9e63ba8af688a372 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb093 expref: 14 pid: 14304 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779789.459201:0:14296:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98e7430d3200/0x9e63ba8af688a372 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb093 expref: 14 pid: 14304 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779789.459213:0:14294:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98e7430d2400/0x9e63ba8af688a33a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb031 expref: 14 pid: 14304 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779789.459867:0:14296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e7430d3200/0x9e63ba8af688a372 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb093 expref: 14 pid: 14304 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779789.459890:0:14296:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787779789.460005:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec9c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b38d1ba0-13da-4ef7-a48d-bd7b24ab8218+13:2360:x1874622505139968:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 833us (1481us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779789.460029:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 8 00010000:00010000:2.0:1787779789.461445:0:14294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e7430d2400/0x9e63ba8af688a33a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb031 expref: 12 pid: 14304 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779789.461467:0:14294:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98e848f69600/0x9e63ba8af688a39c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779789.461476:0:14294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e848f69600/0x9e63ba8af688a39c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779789.461537:0:14294:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98e848f69600/0x9e63ba8af688a39c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779789.461546:0:14294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98e848f69600/0x9e63ba8af688a39c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779789.461554:0:14294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98e848f69600/0x9e63ba8af688a39c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779789.461560:0:14294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98e848f69600/0x9e63ba8af688a39c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779789.461566:0:14294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e848f69600 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:3.0:1787779789.461571:0:14294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98e848f69600/0x9e63ba8af688a39c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779789.461579:0:14294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98e848f69600/0x9e63ba8af688a39c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779789.461944:0:16427:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98e848f69600/0x9e63ba8af688a39c lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779789.461954:0:16427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98e848f69600/0x9e63ba8af688a39c lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779789.466760:0:14294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98e848f69600/0x9e63ba8af688a39c lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779789.466783:0:14294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e848f69600/0x9e63ba8af688a39c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779789.466806:0:14294:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787779789.466884:0:14294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec9cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b38d1ba0-13da-4ef7-a48d-bd7b24ab8218+11:2360:x1874622505140096:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 7711us (8251us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779789.466906:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 7 00000040:00080000:2.0:1787779789.559142:0:14343:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787779790.324387:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787779791.026822:0:14306:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787779791.026831:0:14306:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98e873adf000 from 10 10000000:01000000:1.0:1787779791.026837:0:14306:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787779791.026889:0:14306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e87a94ea00/0x9e63ba8af688a3a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779791.026902:0:14306:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff98e87a94ea00/0x9e63ba8af688a3a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779791.026913:0:14306:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff98e87a94ea00/0x9e63ba8af688a3a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779791.026942:0:14306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ece5680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14306:1874622525059456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787779791.027025:0:14306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779791.027074:0:14306:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e8480b3780 going to sleep for 11 seconds 00000100:00100000:3.0:1787779791.027135:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525059456 00000100:00100000:3.0:1787779791.027144:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525059456 00000100:00100000:3.0:1787779791.027207:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787779791.027216:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+16:14306:x1874622525059456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787779791.027231:0:14304:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779791.027246:0:14304:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e8429d5200/0x9e63ba8af688a3aa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9e63ba8af688a3a3 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779791.027267:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e8429d5200/0x9e63ba8af688a3aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9e63ba8af688a3a3 expref: 17 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779791.027277:0:14304:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e8429d5200/0x9e63ba8af688a3aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af688a3a3 expref: 17 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779791.027287:0:14304:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e8429d5200, rc 0) 00000100:00100000:3.0:1787779791.027339:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+17:14306:x1874622525059456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779791.027346:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787779791.027472:0:14306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ece5680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14306:1874622525059456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787779791.027558:0:14306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff98e87a94ea00/0x9e63ba8af688a3a3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af688a3aa expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779791.027595:0:14306:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff98e87a94ea00/0x9e63ba8af688a3a3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9e63ba8af688a3aa expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779791.027657:0:14306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f6b5e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14306:1874622525059584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787779791.027687:0:14306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779791.028502:0:14306:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e8450a93c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787779791.037225:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525059584 00000100:00100000:3.0:1787779791.037240:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525059584 00000100:00100000:3.0:1787779791.037290:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787779791.037300:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+17:14306:x1874622525059584:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787779791.042159:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+17:14306:x1874622525059584:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 4851us (14461us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779791.042174:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787779791.042422:0:14306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f6b5e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14306:1874622525059584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787779791.042553:0:14306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87f6b5e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14306:1874622525059712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787779791.042606:0:14306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779791.042694:0:14306:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e8450a93c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787779791.048377:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525059712 00000100:00100000:1.0:1787779791.048391:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525059712 00000100:00100000:1.0:1787779791.048567:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787779791.048577:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+17:14306:x1874622525059712:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787779791.049128:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+17:14306:x1874622525059712:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 551us (6521us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779791.049145:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787779791.049368:0:14306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87f6b5e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14306:1874622525059712:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787779791.051621:0:16481:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1787779791.052137:0:14306:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1787779791.052167:0:14306:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787779791.052179:0:14306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e87a94ea00/0x9e63ba8af688a3a3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af688a3aa expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779791.052191:0:14306:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff98e87a94ea00/0x9e63ba8af688a3a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af688a3aa expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787779791.052201:0:14306:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787779791.052203:0:14306:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98e846326800 from 10 10000000:01000000:3.0:1787779791.052206:0:14306:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787779791.052241:0:14306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e8429d5400/0x9e63ba8af688a3b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779791.052250:0:14306:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff98e8429d5400/0x9e63ba8af688a3b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779791.052262:0:14306:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff98e8429d5400/0x9e63ba8af688a3b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779791.052287:0:14306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ec9ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14306:1874622525059840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787779791.052353:0:14306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779791.052400:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525059840 00000100:00100000:3.0:1787779791.052404:0:14306:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e84975f480 going to sleep for 11 seconds 00000100:00100000:0.0:1787779791.052408:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525059840 00000100:00100000:0.0:1787779791.052573:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787779791.052584:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+17:14306:x1874622525059840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787779791.052597:0:14304:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787779791.052612:0:14304:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e848f69200/0x9e63ba8af688a3b8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9e63ba8af688a3b1 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779791.052646:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e848f69200/0x9e63ba8af688a3b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9e63ba8af688a3b1 expref: 18 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779791.052807:0:14304:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e848f69200/0x9e63ba8af688a3b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af688a3b1 expref: 18 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779791.052818:0:14304:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e848f69200, rc 0) 00000100:00100000:0.0:1787779791.052862:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+18:14306:x1874622525059840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 281us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779791.052869:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787779791.053693:0:14306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ec9ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14306:1874622525059840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787779791.053743:0:14306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff98e8429d5400/0x9e63ba8af688a3b1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af688a3b8 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779791.053755:0:14306:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff98e8429d5400/0x9e63ba8af688a3b1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9e63ba8af688a3b8 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779791.053832:0:14306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ec9ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14306:1874622525059968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787779791.053883:0:14306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779791.053923:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525059968 00000100:00100000:0.0:1787779791.053929:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525059968 00000100:00100000:3.0:1787779791.053938:0:14306:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e84975f480 going to sleep for 11 seconds 00000100:00100000:0.0:1787779791.054000:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787779791.054009:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+18:14306:x1874622525059968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787779791.055143:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+18:14306:x1874622525059968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1130us (1255us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779791.055153:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787779791.055354:0:14306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ec9ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14306:1874622525059968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787779791.055398:0:14306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ec9ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14306:1874622525060096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787779791.055443:0:14306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779791.055480:0:14306:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e84975f480 going to sleep for 11 seconds 00000100:00100000:0.0:1787779791.058587:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525060096 00000100:00100000:0.0:1787779791.058606:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525060096 00000100:00100000:0.0:1787779791.058667:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787779791.058678:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+18:14306:x1874622525060096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787779791.059759:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+18:14306:x1874622525060096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1079us (4311us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779791.059772:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787779791.059780:0:14306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ec9ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14306:1874622525060096:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787779791.061795:0:16484:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1787779791.061902:0:14306:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1787779791.061929:0:14306:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787779791.061941:0:14306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e8429d5400/0x9e63ba8af688a3b1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af688a3b8 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779791.061970:0:14306:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff98e8429d5400/0x9e63ba8af688a3b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af688a3b8 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787779791.061982:0:14306:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787779791.061984:0:14306:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98e87f66b000 from 10 10000000:01000000:1.0:1787779791.061987:0:14306:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787779791.062027:0:14306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e87a94e800/0x9e63ba8af688a3bf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779791.062034:0:14306:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.109@tcp lock: ffff98e87a94e800/0x9e63ba8af688a3bf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779791.062044:0:14306:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.109@tcp lock: ffff98e87a94e800/0x9e63ba8af688a3bf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779791.062067:0:14306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ece52c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14306:1874622525060224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787779791.062131:0:14306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779791.062176:0:14306:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e85d939e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787779791.062217:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525060224 00000100:00100000:3.0:1787779791.062225:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525060224 00000100:00100000:3.0:1787779791.062265:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787779791.062274:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+18:14306:x1874622525060224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787779791.062286:0:14303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779791.062299:0:14303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e8429d5800/0x9e63ba8af688a3c6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9e63ba8af688a3bf expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779791.062323:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e8429d5800/0x9e63ba8af688a3c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9e63ba8af688a3bf expref: 19 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779791.062335:0:14303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e8429d5800/0x9e63ba8af688a3c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9e63ba8af688a3bf expref: 19 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779791.062344:0:14303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e8429d5800, rc 0) 00000100:00100000:3.0:1787779791.062395:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+19:14306:x1874622525060224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779791.062402:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787779791.062883:0:14306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ece52c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14306:1874622525060224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787779791.062905:0:14306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.109@tcp lock: ffff98e87a94e800/0x9e63ba8af688a3bf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af688a3c6 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779791.062916:0:14306:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.109@tcp lock: ffff98e87a94e800/0x9e63ba8af688a3bf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9e63ba8af688a3c6 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779791.062995:0:14306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ece52c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14306:1874622525060352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787779791.063032:0:14306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779791.063065:0:14306:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e85d939e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787779791.063535:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525060352 00000100:00100000:0.0:1787779791.063541:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525060352 00000100:00100000:0.0:1787779791.063582:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787779791.063590:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e84517e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+19:14306:x1874622525060352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787779791.063978:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e84517e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+19:14306:x1874622525060352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 387us (943us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779791.063993:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787779791.064359:0:14306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ece52c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14306:1874622525060352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787779791.064403:0:14306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ece52c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14306:1874622525060480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787779791.064444:0:14306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779791.064483:0:14306:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e85d939e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787779791.064521:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525060480 00000100:00100000:3.0:1787779791.064527:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525060480 00000100:00100000:3.0:1787779791.064570:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787779791.064578:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e84517d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+19:14306:x1874622525060480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787779791.064771:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e84517d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+19:14306:x1874622525060480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 193us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779791.064778:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787779791.065047:0:14306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ece52c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:14306:1874622525060480:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787779791.068313:0:16485:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1787779791.069565:0:14306:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1787779791.069592:0:14306:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787779791.069602:0:14306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.109@tcp lock: ffff98e87a94e800/0x9e63ba8af688a3bf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af688a3c6 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779791.069615:0:14306:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.109@tcp lock: ffff98e87a94e800/0x9e63ba8af688a3bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9e63ba8af688a3c6 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779791.355732:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779791.456572:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779791.456763:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505140224 00000100:00100000:1.0:1787779791.456775:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505140224 00000100:00100000:1.0:1787779791.456825:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 115 00000100:00100000:1.0:1787779791.456835:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e84517cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b38d1ba0-13da-4ef7-a48d-bd7b24ab8218+11:13776:x1874622505140224:12345-192.168.201.9@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787779791.456853:0:14304:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779791.456873:0:14304:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e87a94f400/0x9e63ba8af688a3cd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedb0c4 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779791.457046:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e87a94f400/0x9e63ba8af688a3cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb0c4 expref: 12 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779791.457059:0:14304:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e87a94f400/0x9e63ba8af688a3cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb0c4 expref: 12 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779791.457081:0:14304:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87a94f400, rc 0) 00000100:00100000:1.0:1787779791.457191:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e84517cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b38d1ba0-13da-4ef7-a48d-bd7b24ab8218+12:13776:x1874622505140224:12345-192.168.201.9@tcp:101:ll_cfg_requeue.0 Request processed in 357us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779791.457199:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 115 00000100:00100000:0.0:1787779791.461283:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779791.461440:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505140352 00000100:00100000:1.0:1787779791.461451:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505140352 00000100:00100000:1.0:1787779791.461513:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 116 00000100:00100000:1.0:1787779791.461522:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e84517fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b38d1ba0-13da-4ef7-a48d-bd7b24ab8218+12:13776:x1874622505140352:12345-192.168.201.9@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787779791.461848:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e84517fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b38d1ba0-13da-4ef7-a48d-bd7b24ab8218+12:13776:x1874622505140352:12345-192.168.201.9@tcp:501:ll_cfg_requeue.0 Request processed in 325us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779791.461859:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 116 00000100:00100000:2.0:1787779791.472813:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779791.473197:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505140480 00000100:00100000:3.0:1787779791.473209:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505140480 00000100:00100000:3.0:1787779791.473269:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 117 00000100:00100000:3.0:1787779791.473280:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e84517dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b38d1ba0-13da-4ef7-a48d-bd7b24ab8218+12:13776:x1874622505140480:12345-192.168.201.9@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787779791.473634:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e84517dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b38d1ba0-13da-4ef7-a48d-bd7b24ab8218+12:13776:x1874622505140480:12345-192.168.201.9@tcp:503:ll_cfg_requeue.0 Request processed in 354us (828us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779791.473642:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 117 00000100:00100000:2.0:1787779791.480929:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779791.481189:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505140608 00000100:00100000:3.0:1787779791.481205:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505140608 00000100:00100000:3.0:1787779791.481278:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 118 00000100:00100000:3.0:1787779791.481290:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e84517f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b38d1ba0-13da-4ef7-a48d-bd7b24ab8218+12:13776:x1874622505140608:12345-192.168.201.9@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787779791.481312:0:14304:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779791.482138:0:14304:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e8429d4c00/0x9e63ba8af688a3d4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedb0cb expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779791.482178:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e8429d4c00/0x9e63ba8af688a3d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb0cb expref: 13 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779791.482190:0:14304:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e8429d4c00/0x9e63ba8af688a3d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb0cb expref: 13 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779791.482219:0:14304:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e8429d4c00, rc 0) 00000100:00100000:3.0:1787779791.482282:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e84517f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b38d1ba0-13da-4ef7-a48d-bd7b24ab8218+13:13776:x1874622505140608:12345-192.168.201.9@tcp:101:ll_cfg_requeue.0 Request processed in 993us (1363us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779791.482290:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 118 00000100:00100000:2.0:1787779791.489019:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779791.490128:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505140736 00000100:00100000:3.0:1787779791.490140:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505140736 00000100:00100000:3.0:1787779791.490193:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 119 00000100:00100000:3.0:1787779791.490201:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e84517c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b38d1ba0-13da-4ef7-a48d-bd7b24ab8218+13:13776:x1874622505140736:12345-192.168.201.9@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787779791.490465:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e84517c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b38d1ba0-13da-4ef7-a48d-bd7b24ab8218+13:13776:x1874622505140736:12345-192.168.201.9@tcp:501:ll_cfg_requeue.0 Request processed in 264us (1457us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779791.490471:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 119 00000100:00100000:2.0:1787779791.500891:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779791.506536:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505140864 00000100:00100000:3.0:1787779791.506553:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505140864 00000100:00100000:3.0:1787779791.508855:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 120 00000100:00100000:3.0:1787779791.508870:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e84517c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b38d1ba0-13da-4ef7-a48d-bd7b24ab8218+13:13776:x1874622505140864:12345-192.168.201.9@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787779791.509119:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e84517c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b38d1ba0-13da-4ef7-a48d-bd7b24ab8218+13:13776:x1874622505140864:12345-192.168.201.9@tcp:503:ll_cfg_requeue.0 Request processed in 250us (8236us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779791.509129:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 120 00000100:00100000:3.0:1787779791.519906:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779791.521081:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779791.521109:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779791.522632:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505141376 00000100:00100000:1.0:1787779791.522648:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505141376 00000100:00100000:1.0:1787779791.522743:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 25 00000100:00100000:1.0:1787779791.522754:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9f07da6d-bdd3-44fa-ab17-edf321a3c5bb+6:2358:x1874622505141376:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:1.0:1787779791.522837:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9f07da6d-bdd3-44fa-ab17-edf321a3c5bb+6:2358:x1874622505141376:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 86us (1763us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779791.522845:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 25 00000100:00080000:1.0:1787779791.522867:0:14305:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787779791.528663:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779791.528704:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505140992 00000100:00100000:3.0:1787779791.528732:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505140992 00000100:00100000:3.0:1787779791.528811:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 26 00000100:00100000:3.0:1787779791.528821:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec9fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:43b382b8-5aec-409a-8dc5-84d259a200e7+6:2358:x1874622505140992:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:3.0:1787779791.529550:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec9fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:43b382b8-5aec-409a-8dc5-84d259a200e7+6:2358:x1874622505140992:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 728us (894us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779791.529557:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 26 00000100:00100000:3.0:1787779791.529613:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00080000:2.0:1787779791.534801:0:14305:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787779791.535459:0:14993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505141120 00000100:00100000:0.0:1787779791.535471:0:14993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505141120 00000100:00100000:0.0:1787779791.535555:0:14993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505141632 00000100:00100000:0.0:1787779791.535559:0:14993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505141632 00000100:00100000:0.0:1787779791.535584:0:14993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 12 00000100:00100000:0.0:1787779791.535596:0:14993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec9ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:43b382b8-5aec-409a-8dc5-84d259a200e7+5:2358:x1874622505141120:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:2.0:1787779791.535657:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 13 00000100:00100000:2.0:1787779791.535668:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec9e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9f07da6d-bdd3-44fa-ab17-edf321a3c5bb+5:2358:x1874622505141632:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:2.0:1787779791.535770:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec9e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9f07da6d-bdd3-44fa-ab17-edf321a3c5bb+5:2358:x1874622505141632:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 105us (14658us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779791.535778:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 13 00000100:00100000:2.0:1787779791.535809:0:14991:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1787779791.535816:0:14991:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1787779791.535906:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00080000:3.0:1787779791.536829:0:14305:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787779791.536835:0:14305:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787779791.536921:0:14993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec9ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:43b382b8-5aec-409a-8dc5-84d259a200e7+5:2358:x1874622505141120:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 1327us (17025us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779791.536931:0:14993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 12 00000100:00100000:0.0:1787779791.536963:0:14993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505141248 00000100:00100000:0.0:1787779791.536968:0:14993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505141248 00000100:00100000:0.0:1787779791.536997:0:14993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505141504 00000100:00100000:0.0:1787779791.537000:0:14993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505141504 00000100:00100000:0.0:1787779791.537015:0:14993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 14 00000100:00100000:0.0:1787779791.537023:0:14993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec9d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:43b382b8-5aec-409a-8dc5-84d259a200e7+5:2358:x1874622505141248:12345-192.168.201.9@tcp:400:kworker.0 00000100:00080000:3.0:1787779791.537027:0:14305:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787779791.537030:0:14305:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787779791.537048:0:14993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec9d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:43b382b8-5aec-409a-8dc5-84d259a200e7+5:2358:x1874622505141248:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 26us (7434us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779791.537055:0:14993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 14 00000100:00100000:0.0:1787779791.537067:0:14993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 15 00000100:00100000:0.0:1787779791.537073:0:14993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec9de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9f07da6d-bdd3-44fa-ab17-edf321a3c5bb+5:2358:x1874622505141504:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:0.0:1787779791.537113:0:14993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec9de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9f07da6d-bdd3-44fa-ab17-edf321a3c5bb+5:2358:x1874622505141504:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 40us (1208us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779791.537131:0:14993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 15 00010000:00010000:1.0:1787779792.371074:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779792.819099:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ec9f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874622525060608:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787779792.819239:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779792.819319:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525060608 00000100:00100000:3.0:1787779792.819326:0:14996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525060608 00000100:00100000:3.0:1787779792.819383:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787779792.819392:0:14996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e852b9da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874622525060608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787779792.819429:0:14996:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787779792.819474:0:14996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e852b9da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874622525060608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779792.819481:0:14996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1787779792.819501:0:14305:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787779792.819553:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ec9f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874622525060608:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787779792.828490:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87a70a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:3305:1874622525060736:0@lo:400:kworker.0 00000100:00100000:1.0:1787779792.828586:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779792.828615:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525060736 00000100:00100000:2.0:1787779792.828623:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525060736 00000100:00100000:2.0:1787779792.828672:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787779792.828684:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87a709680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622525060864:0@lo:400:kworker.0 00000100:00100000:2.0:1787779792.828696:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e84517e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+19:3305:x1874622525060736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779792.828733:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779792.828759:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e84517e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+19:3305:x1874622525060736:12345-0@lo:400:kworker.0 Request processed in 66us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779792.828767:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787779792.829051:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ece4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874622525060992:0@lo:400:kworker.0 00000100:00100000:1.0:1787779792.829086:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779792.829210:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525060992 00000100:00100000:1.0:1787779792.829215:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525060992 00000100:00100000:1.0:1787779792.829246:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787779792.829255:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ece4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874622525060992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779792.829294:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ece4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874622525060992:12345-0@lo:400:kworker.0 Request processed in 41us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779792.829300:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787779792.829339:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ece4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874622525060992:0@lo:400:kworker.0 00000100:00100000:1.0:1787779792.829368:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525060864 00000100:00100000:1.0:1787779792.829371:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525060864 00000100:00100000:1.0:1787779792.829407:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787779792.829414:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a7083c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622525060864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779792.829508:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ece5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874622525061248:0@lo:400:kworker.0 00000100:00100000:3.0:1787779792.829547:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779792.829574:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87a70a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:3305:1874622525060736:0@lo:400:kworker.0 00000100:00100000:3.0:1787779792.829595:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787779792.829601:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ece5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1874622525061120:0@lo:400:kworker.0 00000100:00100000:3.0:1787779792.829632:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779792.829659:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525061248 00000100:00100000:3.0:1787779792.829663:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525061248 00000100:00100000:3.0:1787779792.829687:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525061120 00000100:00100000:3.0:1787779792.829690:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525061120 00000100:00100000:3.0:1787779792.829727:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787779792.829734:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e852b9fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874622525061248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779792.829770:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e852b9fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874622525061248:12345-0@lo:400:kworker.0 Request processed in 37us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779792.829776:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787779792.829789:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787779792.829794:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e852b9f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874622525061120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779792.829826:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e852b9f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874622525061120:12345-0@lo:400:kworker.0 Request processed in 32us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779792.829832:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1787779792.829859:0:14305:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787779792.829863:0:14305:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787779792.829884:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ece5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1874622525061120:0@lo:400:kworker.0 00000100:00100000:3.0:1787779792.829895:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ece5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874622525061248:0@lo:400:kworker.0 00000100:00100000:1.0:1787779792.844222:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a7083c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622525060864:12345-0@lo:400:kworker.0 Request processed in 14797us (15476us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779792.844237:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787779792.849312:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87a709680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622525060864:0@lo:400:kworker.0 00000100:00100000:3.0:1787779793.295517:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779793.295689:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505141760 00000100:00100000:0.0:1787779793.295700:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505141760 00000100:00100000:0.0:1787779793.295828:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 15 00000100:00100000:0.0:1787779793.295841:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec9f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:43b382b8-5aec-409a-8dc5-84d259a200e7+6:14432:x1874622505141760:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787779793.295863:0:14311:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787779793.295885:0:14311:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69a00/0x9e63ba8af688a3db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedb0d2 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779793.295964:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68400/0x9e63ba8af688a3e2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779793.295980:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68400/0x9e63ba8af688a3e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779793.295994:0:14311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68400/0x9e63ba8af688a3e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779793.296009:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af688a3e9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779793.296016:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af688a3e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779793.296043:0:14311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af688a3e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779793.296527:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68e00/0x9e63ba8af688a3f0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787779793.296647:0:14305:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787779793.296781:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68e00/0x9e63ba8af688a3f0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779793.296791:0:14311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68e00/0x9e63ba8af688a3f0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787779793.296883:0:14311:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787779793.296887:0:14311:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787779793.296999:0:14311:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68e00/0x9e63ba8af688a3f0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779793.297012:0:14311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68400/0x9e63ba8af688a3e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779793.297019:0:14311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68400/0x9e63ba8af688a3e2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779793.297026:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68400/0x9e63ba8af688a3e2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779793.297032:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e848f68400 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:0.0:1787779793.297037:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68400/0x9e63ba8af688a3e2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779793.297044:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68400/0x9e63ba8af688a3e2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779793.297065:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e860e78a00) 00010000:00010000:0.0:1787779793.297068:0:14311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787779793.297074:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68400/0x9e63ba8af688a3e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779793.297080:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68400/0x9e63ba8af688a3e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779793.297093:0:14311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af688a3e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779793.297099:0:14311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af688a3e9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779793.297105:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af688a3e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779793.297110:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e848f68000 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:0.0:1787779793.297114:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af688a3e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779793.297119:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af688a3e9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779793.297126:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff98e860e78b00) 00010000:00010000:0.0:1787779793.297128:0:14311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787779793.297131:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af688a3e9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779793.297136:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af688a3e9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779793.297187:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69a00/0x9e63ba8af688a3db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb0d2 expref: 8 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779793.297202:0:14311:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68e00/0x9e63ba8af688a3f0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb0d2 expref: 7 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779793.297209:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98e860e78e00) 00010000:00010000:0.0:1787779793.297211:0:14311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787779793.297213:0:14311:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e848f68e00, rc 0) 00000100:00100000:0.0:1787779793.297326:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec9f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:43b382b8-5aec-409a-8dc5-84d259a200e7+7:14432:x1874622505141760:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 Request processed in 1489us (1819us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779793.297335:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 15 00000100:00100000:2.0:1787779793.311257:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779793.311358:0:16187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505142016 00000100:00100000:3.0:1787779793.311368:0:16187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505142016 00000100:00100000:3.0:1787779793.311431:0:16187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 16 00000100:00100000:3.0:1787779793.311442:0:16187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f6b4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:43b382b8-5aec-409a-8dc5-84d259a200e7+7:14432:x1874622505142016:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787779793.311490:0:16187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779793.311516:0:16187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4a00/0x9e63ba8af688a3f7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedb0d9 expref: -99 pid: 16187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779793.311612:0:16187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4200/0x9e63ba8af688a3fe lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779793.311627:0:16187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4200/0x9e63ba8af688a3fe lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779793.311640:0:16187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4200/0x9e63ba8af688a3fe lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779793.311652:0:16187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5600/0x9e63ba8af688a405 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779793.311658:0:16187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5600/0x9e63ba8af688a405 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779793.311665:0:16187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5600/0x9e63ba8af688a405 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779793.312266:0:16187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af688a40c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779793.312278:0:16187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af688a40c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779793.312285:0:16187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af688a40c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787779793.312294:0:16187:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1787779793.312564:0:16187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4200/0x9e63ba8af688a3fe lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779793.312572:0:16187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4200/0x9e63ba8af688a3fe lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779793.312579:0:16187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4200/0x9e63ba8af688a3fe lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779793.312585:0:16187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e8429d4200 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:3.0:1787779793.312590:0:16187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4200/0x9e63ba8af688a3fe lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779793.312598:0:16187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4200/0x9e63ba8af688a3fe lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779793.312613:0:16187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98e860e78e00) 00010000:00010000:3.0:1787779793.312616:0:16187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779793.312620:0:16187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4200/0x9e63ba8af688a3fe lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779793.312626:0:16187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4200/0x9e63ba8af688a3fe lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779793.312642:0:16187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5600/0x9e63ba8af688a405 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779793.312648:0:16187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5600/0x9e63ba8af688a405 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779793.312654:0:16187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5600/0x9e63ba8af688a405 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779793.312669:0:16187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e8429d5600 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:3.0:1787779793.312673:0:16187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5600/0x9e63ba8af688a405 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779793.312679:0:16187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5600/0x9e63ba8af688a405 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779793.312687:0:16187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff98e87450ad00) 00010000:00010000:3.0:1787779793.312689:0:16187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779793.312692:0:16187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5600/0x9e63ba8af688a405 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779793.312697:0:16187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5600/0x9e63ba8af688a405 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779793.313268:0:16187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4a00/0x9e63ba8af688a3f7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb0d9 expref: 10 pid: 16187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779793.313287:0:16187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4e00/0x9e63ba8af688a40c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb0d9 expref: 9 pid: 16187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779793.313295:0:16187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98e87450a000) 00010000:00010000:3.0:1787779793.313297:0:16187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779793.313300:0:16187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e8429d4e00, rc 0) 00000100:00100000:3.0:1787779793.313381:0:16187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f6b4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:43b382b8-5aec-409a-8dc5-84d259a200e7+9:14432:x1874622505142016:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 Request processed in 1940us (2138us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1787779793.313391:0:16187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 16 00000100:00100000:2.0:1787779793.318625:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779793.318741:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505142144 00000100:00100000:3.0:1787779793.318764:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505142144 00000100:00100000:3.0:1787779793.318813:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 17 00000100:00100000:3.0:1787779793.318823:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f6b61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:43b382b8-5aec-409a-8dc5-84d259a200e7+9:14432:x1874622505142144:12345-192.168.201.9@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1787779793.318947:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f6b61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:43b382b8-5aec-409a-8dc5-84d259a200e7+9:14432:x1874622505142144:12345-192.168.201.9@tcp:59:lhsmtool_posix.0 Request processed in 125us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779793.318956:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 17 00000100:00100000:2.0:1787779793.366836:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779793.367039:0:16187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505142272 00000100:00100000:3.0:1787779793.367049:0:16187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505142272 00000100:00100000:3.0:1787779793.367107:0:16187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 18 00000100:00100000:3.0:1787779793.367116:0:16187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f6b7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:43b382b8-5aec-409a-8dc5-84d259a200e7+9:14438:x1874622505142272:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:3.0:1787779793.367137:0:16187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779793.367156:0:16187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4a00/0x9e63ba8af688a41a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedb0e0 expref: -99 pid: 16187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779793.367213:0:16187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5600/0x9e63ba8af688a421 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779793.367228:0:16187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5600/0x9e63ba8af688a421 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779793.367239:0:16187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5600/0x9e63ba8af688a421 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779793.367252:0:16187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4200/0x9e63ba8af688a428 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779793.367259:0:16187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4200/0x9e63ba8af688a428 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779793.367265:0:16187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4200/0x9e63ba8af688a428 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779793.368046:0:16187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5600/0x9e63ba8af688a421 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779793.368060:0:16187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5600/0x9e63ba8af688a421 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779793.368067:0:16187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5600/0x9e63ba8af688a421 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779793.368074:0:16187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e8429d5600 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:3.0:1787779793.368078:0:16187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5600/0x9e63ba8af688a421 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779793.368085:0:16187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5600/0x9e63ba8af688a421 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779793.368099:0:16187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e860e78a00) 00010000:00010000:3.0:1787779793.368101:0:16187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779793.368106:0:16187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5600/0x9e63ba8af688a421 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779793.368112:0:16187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5600/0x9e63ba8af688a421 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779793.368124:0:16187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4200/0x9e63ba8af688a428 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779793.368130:0:16187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4200/0x9e63ba8af688a428 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779793.368135:0:16187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4200/0x9e63ba8af688a428 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779793.368148:0:16187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e8429d4200 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:3.0:1787779793.368151:0:16187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4200/0x9e63ba8af688a428 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779793.368156:0:16187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4200/0x9e63ba8af688a428 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779793.368164:0:16187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff98e87450ad00) 00010000:00010000:3.0:1787779793.368167:0:16187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779793.368170:0:16187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4200/0x9e63ba8af688a428 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779793.368176:0:16187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4200/0x9e63ba8af688a428 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779793.368216:0:16187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4a00/0x9e63ba8af688a41a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb0e0 expref: 10 pid: 16187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779793.368225:0:16187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e860e78a00) 00010000:00010000:3.0:1787779793.368228:0:16187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779793.368231:0:16187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4a00/0x9e63ba8af688a41a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb0e0 expref: 10 pid: 16187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779793.368239:0:16187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e8429d4a00, rc 0) 00000100:00100000:3.0:1787779793.368309:0:16187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f6b7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:43b382b8-5aec-409a-8dc5-84d259a200e7+9:14438:x1874622505142272:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 1193us (1480us total) trans 0 rc 301/301 00000100:00100000:3.0:1787779793.368317:0:16187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 18 00000100:00100000:2.0:1787779793.372979:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779793.373122:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505142400 00000100:00100000:3.0:1787779793.373143:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505142400 00000100:00100000:3.0:1787779793.373199:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 0 00000100:00100000:3.0:1787779793.373209:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f6b7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:43b382b8-5aec-409a-8dc5-84d259a200e7+9:14438:x1874622505142400:12345-192.168.201.9@tcp:700:lfs.0 00000100:00100000:3.0:1787779793.373378:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f6b7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:43b382b8-5aec-409a-8dc5-84d259a200e7+9:14438:x1874622505142400:12345-192.168.201.9@tcp:700:lfs.0 Request processed in 171us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779793.373386:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 0 00000100:00100000:2.0:1787779793.376439:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779793.376527:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505142656 00000100:00100000:3.0:1787779793.376547:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505142656 00000100:00100000:3.0:1787779793.376608:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 19 00000100:00100000:3.0:1787779793.376618:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f6b5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:43b382b8-5aec-409a-8dc5-84d259a200e7+9:14438:x1874622505142656:12345-192.168.201.9@tcp:36:lfs.0 00010000:00010000:3.0:1787779793.376670:0:14309:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787779793.376697:0:14309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af688a35d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb05b expref: 9 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779793.377018:0:14309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e860e78a00) 00010000:00010000:3.0:1787779793.377025:0:14309:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787779793.377298:0:14309:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4a00/0x9e63ba8af688a42f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779793.377314:0:14309:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d3c00/0x9e63ba8af688a395 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb0bd expref: 5 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779793.377323:0:14309:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4a00/0x9e63ba8af688a42f lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779793.377357:0:14309:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d3c00/0x9e63ba8af688a395 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb0bd expref: 5 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779793.377384:0:14309:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d3c00/0x9e63ba8af688a395 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb0bd expref: 5 pid: 14311 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779793.377400:0:14309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e74353ed00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14309:1874622525061376:192.168.201.9@tcp:104: 00000100:00100000:3.0:1787779793.377546:0:14309:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e86d5a8d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787779793.380689:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779793.381022:0:14309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e74353ed00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14309:1874622525061376:192.168.201.9@tcp:104: 00010000:00010000:3.0:1787779793.381047:0:14309:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4a00/0x9e63ba8af688a42f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779793.381092:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505142784 00000100:00100000:1.0:1787779793.381099:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505142784 00010000:00010000:1.0:1787779793.381185:0:14295:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d3c00/0x9e63ba8af688a395 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb0bd expref: 6 pid: 14311 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779793.381226:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 9 00000100:00100000:1.0:1787779793.381236:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a709680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9f07da6d-bdd3-44fa-ab17-edf321a3c5bb+6:2359:x1874622505142784:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787779793.381251:0:14295:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787779793.381259:0:14295:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d3c00/0x9e63ba8af688a395 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb0bd expref: 6 pid: 14311 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779793.381271:0:14295:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d3c00/0x9e63ba8af688a395 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb0bd expref: 6 pid: 14311 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779793.381311:0:14295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d3c00/0x9e63ba8af688a395 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb0bd expref: 6 pid: 14311 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779793.381327:0:14295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e860e78a00) 00010000:00010000:1.0:1787779793.381332:0:14295:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4a00/0x9e63ba8af688a42f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779793.381340:0:14295:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4a00/0x9e63ba8af688a42f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779793.381347:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4a00/0x9e63ba8af688a42f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779793.381377:0:14295:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787779793.381427:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a709680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9f07da6d-bdd3-44fa-ab17-edf321a3c5bb+5:2359:x1874622505142784:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 192us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779793.381434:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 9 00010000:00010000:0.0:1787779793.382474:0:14309:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4a00/0x9e63ba8af688a42f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779793.382486:0:14309:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4a00/0x9e63ba8af688a42f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779793.382513:0:14309:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af688a436 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779793.382524:0:14309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af688a436 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779793.382542:0:14309:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af688a436 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787779793.384462:0:14309:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1787779793.384486:0:14309:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4a00/0x9e63ba8af688a42f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779793.384497:0:14309:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4a00/0x9e63ba8af688a42f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779793.384504:0:14309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4a00/0x9e63ba8af688a42f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779793.384511:0:14309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e8429d4a00 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:0.0:1787779793.384516:0:14309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4a00/0x9e63ba8af688a42f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779793.384524:0:14309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4a00/0x9e63ba8af688a42f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787779793.385119:0:14305:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787779793.385267:0:14309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e860e78a00) 00010000:00010000:0.0:1787779793.385272:0:14309:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787779793.385287:0:14309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4a00/0x9e63ba8af688a42f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779793.385295:0:14309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4a00/0x9e63ba8af688a42f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787779793.385321:0:14309:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003ae65dd5 reply state 000000009952c81e transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af688a436 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779793.385331:0:14309:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787779793.385437:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f6b5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:43b382b8-5aec-409a-8dc5-84d259a200e7+10:14438:x1874622505142656:12345-192.168.201.9@tcp:36:lfs.0 Request processed in 8817us (9003us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1787779793.385447:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 19 00010000:00010000:3.0:1787779793.389166:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af688a436 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779793.389184:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af688a436 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779793.389193:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af688a436 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779793.389200:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e848f68000 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:3.0:1787779793.389205:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af688a436 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779793.389212:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af688a436 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779793.389229:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff98e860e78b00) 00010000:00010000:3.0:1787779793.389233:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779793.389251:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af688a436 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779793.389258:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af688a436 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779793.395112:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779793.442240:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779793.442354:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505142912 00000100:00100000:3.0:1787779793.442364:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505142912 00000100:00100000:3.0:1787779793.442452:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 20 00000100:00100000:3.0:1787779793.442463:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ece4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:43b382b8-5aec-409a-8dc5-84d259a200e7+9:14446:x1874622505142912:12345-192.168.201.9@tcp:101:lctl.0 00010000:00010000:3.0:1787779793.442489:0:14310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779793.442513:0:14310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4200/0x9e63ba8af688a43d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedb0e7 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779793.442584:0:14310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5600/0x9e63ba8af688a444 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779793.442599:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5600/0x9e63ba8af688a444 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779793.442612:0:14310:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5600/0x9e63ba8af688a444 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787779793.442673:0:14310:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787779793.442677:0:14310:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:3.0:1787779793.442768:0:14310:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5600/0x9e63ba8af688a444 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779793.442811:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4200/0x9e63ba8af688a43d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb0e7 expref: 11 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779793.442834:0:14310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5600/0x9e63ba8af688a444 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb0e7 expref: 10 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779793.442857:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e87450ad00) 00010000:00010000:3.0:1787779793.442872:0:14310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787779793.442876:0:14310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e8429d5600, rc 0) 00000100:00100000:3.0:1787779793.442954:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ece4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:43b382b8-5aec-409a-8dc5-84d259a200e7+10:14446:x1874622505142912:12345-192.168.201.9@tcp:101:lctl.0 Request processed in 492us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779793.442963:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 20 00000100:00100000:0.0:1787779793.463481:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779793.463579:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505143040 00000100:00100000:3.0:1787779793.463589:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505143040 00000100:00100000:3.0:1787779793.463639:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 21 00000100:00100000:3.0:1787779793.463645:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a709a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9f07da6d-bdd3-44fa-ab17-edf321a3c5bb+5:14447:x1874622505143040:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:3.0:1787779793.463663:0:14311:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779793.463679:0:14311:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4200/0x9e63ba8af688a44b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedb0ee expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779793.463764:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5a00/0x9e63ba8af688a452 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779793.463775:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5a00/0x9e63ba8af688a452 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779793.463782:0:14311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5a00/0x9e63ba8af688a452 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787779793.463855:0:14311:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787779793.463859:0:14311:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:3.0:1787779793.463885:0:14311:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5a00/0x9e63ba8af688a452 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779793.463931:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4200/0x9e63ba8af688a44b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb0ee expref: 7 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779793.463952:0:14311:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d5a00/0x9e63ba8af688a452 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb0ee expref: 6 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779793.463961:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e87450ad00) 00010000:00010000:3.0:1787779793.463964:0:14311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787779793.463968:0:14311:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e8429d5a00, rc 0) 00000100:00100000:3.0:1787779793.464018:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a709a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9f07da6d-bdd3-44fa-ab17-edf321a3c5bb+6:14447:x1874622505143040:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 371us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779793.464025:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 21 00000100:00100000:2.0:1787779793.468591:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779793.475046:0:16187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505143168 00000100:00100000:1.0:1787779793.475062:0:16187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505143168 00000100:00100000:1.0:1787779793.475131:0:16187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 22 00000100:00100000:1.0:1787779793.475142:0:16187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e741e6c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9f07da6d-bdd3-44fa-ab17-edf321a3c5bb+6:14447:x1874622505143168:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:1.0:1787779793.475162:0:16187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779793.475184:0:16187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94fc00/0x9e63ba8af688a459 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedb0f5 expref: -99 pid: 16187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779793.475250:0:16187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94e600/0x9e63ba8af688a460 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779793.476497:0:16187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94e600/0x9e63ba8af688a460 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779793.476518:0:16187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94e600/0x9e63ba8af688a460 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779793.476544:0:16187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94fa00/0x9e63ba8af688a467 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779793.476552:0:16187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94fa00/0x9e63ba8af688a467 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779793.476559:0:16187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94fa00/0x9e63ba8af688a467 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779793.476729:0:16187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94e000/0x9e63ba8af688a46e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779793.476738:0:16187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94e000/0x9e63ba8af688a46e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779793.476746:0:16187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94e000/0x9e63ba8af688a46e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787779793.476789:0:16187:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1787779793.476793:0:16187:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787779793.476820:0:16187:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94e000/0x9e63ba8af688a46e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779793.476832:0:16187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94e600/0x9e63ba8af688a460 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779793.476854:0:16187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94e600/0x9e63ba8af688a460 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779793.476861:0:16187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94e600/0x9e63ba8af688a460 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779793.476868:0:16187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87a94e600 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:1.0:1787779793.476872:0:16187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94e600/0x9e63ba8af688a460 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779793.476880:0:16187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94e600/0x9e63ba8af688a460 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779793.476892:0:16187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e87450ad00) 00010000:00010000:1.0:1787779793.476895:0:16187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787779793.476899:0:16187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94e600/0x9e63ba8af688a460 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779793.476904:0:16187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94e600/0x9e63ba8af688a460 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779793.476926:0:16187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94fa00/0x9e63ba8af688a467 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779793.476932:0:16187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94fa00/0x9e63ba8af688a467 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779793.476937:0:16187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94fa00/0x9e63ba8af688a467 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779793.476943:0:16187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87a94fa00 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:1.0:1787779793.476953:0:16187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94fa00/0x9e63ba8af688a467 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779793.476959:0:16187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94fa00/0x9e63ba8af688a467 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779793.476967:0:16187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff98e860e7ea00) 00010000:00010000:1.0:1787779793.476969:0:16187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787779793.476973:0:16187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94fa00/0x9e63ba8af688a467 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779793.476979:0:16187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94fa00/0x9e63ba8af688a467 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779793.477015:0:16187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94fc00/0x9e63ba8af688a459 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb0f5 expref: 8 pid: 16187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779793.477028:0:16187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94e000/0x9e63ba8af688a46e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb0f5 expref: 7 pid: 16187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779793.477035:0:16187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98e860e7e200) 00010000:00010000:1.0:1787779793.477037:0:16187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787779793.477040:0:16187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87a94e000, rc 0) 00000100:00100000:1.0:1787779793.477190:0:16187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e741e6c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9f07da6d-bdd3-44fa-ab17-edf321a3c5bb+7:14447:x1874622505143168:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 2049us (8609us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779793.477199:0:16187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 22 00000100:00100000:1.0:1787779793.491170:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779793.491337:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505143424 00000100:00100000:3.0:1787779793.491347:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505143424 00000100:00100000:3.0:1787779793.491416:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 23 00000100:00100000:3.0:1787779793.491426:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ece7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9f07da6d-bdd3-44fa-ab17-edf321a3c5bb+7:14447:x1874622505143424:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:3.0:1787779793.491460:0:14311:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779793.491482:0:14311:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4200/0x9e63ba8af688a475 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedb0fc expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787779793.492001:0:14311:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787779793.492212:0:14311:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4200/0x9e63ba8af688a475 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb0fc expref: 9 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779793.492229:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e87450ad00) 00010000:00010000:2.0:1787779793.492232:0:14311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787779793.492250:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4200/0x9e63ba8af688a475 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb0fc expref: 9 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779793.492269:0:14311:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e8429d4200, rc 0) 00000100:00100000:2.0:1787779793.492350:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ece7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9f07da6d-bdd3-44fa-ab17-edf321a3c5bb+8:14447:x1874622505143424:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 926us (1192us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1787779793.492358:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 23 00000100:00100000:0.0:1787779793.496488:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779793.496671:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505143680 00000100:00100000:3.0:1787779793.496681:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505143680 00000100:00100000:3.0:1787779793.496780:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 24 00000100:00100000:3.0:1787779793.496791:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a7092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9f07da6d-bdd3-44fa-ab17-edf321a3c5bb+8:14447:x1874622505143680:12345-192.168.201.9@tcp:36:lfs.0 00010000:00010000:3.0:1787779793.496858:0:14310:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787779793.496907:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94e000/0x9e63ba8af688a46e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb0f5 expref: 8 pid: 16187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779793.496938:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98e860e7e200) 00010000:00010000:3.0:1787779793.496949:0:14310:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787779793.496979:0:14310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af688a483 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779793.496994:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af688a483 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779793.497004:0:14310:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af688a483 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787779793.497254:0:14310:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001d28f3a4 reply state 00000000d5c17bbf transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af688a483 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779793.497264:0:14310:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787779793.497278:0:14310:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:3.0:1787779793.497958:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a7092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9f07da6d-bdd3-44fa-ab17-edf321a3c5bb+9:14447:x1874622505143680:12345-192.168.201.9@tcp:36:lfs.0 Request processed in 1166us (1476us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1787779793.497968:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 24 00000100:00100000:2.0:1787779793.514319:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779793.516507:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505143936 00000100:00100000:0.0:1787779793.516525:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505143936 00000100:00100000:0.0:1787779793.516601:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 2 00000100:00100000:0.0:1787779793.516613:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e741e6d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9f07da6d-bdd3-44fa-ab17-edf321a3c5bb+9:14447:x1874622505143936:12345-192.168.201.9@tcp:35:lfs.0 00000100:00100000:0.0:1787779793.517124:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e741e6d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9f07da6d-bdd3-44fa-ab17-edf321a3c5bb+10:14447:x1874622505143936:12345-192.168.201.9@tcp:35:lfs.0 Request processed in 511us (2813us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1787779793.517133:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 2 00010000:00010000:2.0:1787779793.526317:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af688a483 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779793.526336:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af688a483 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779793.526359:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af688a483 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779793.526365:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e8429d4400 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:2.0:1787779793.526370:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af688a483 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779793.526378:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af688a483 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779793.526393:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98e87450a200) 00010000:00010000:2.0:1787779793.526396:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1787779793.526401:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af688a483 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779793.526407:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af688a483 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779793.528256:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779793.528396:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505144192 00000100:00100000:2.0:1787779793.528407:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505144192 00000100:00100000:2.0:1787779793.528478:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 25 00000100:00100000:2.0:1787779793.528490:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a709e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9f07da6d-bdd3-44fa-ab17-edf321a3c5bb+9:14447:x1874622505144192:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:2.0:1787779793.528515:0:14311:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779793.528538:0:14311:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d2e00/0x9e63ba8af688a48a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedb103 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779793.528620:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d2400/0x9e63ba8af688a491 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779793.528634:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d2400/0x9e63ba8af688a491 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779793.528661:0:14311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d2400/0x9e63ba8af688a491 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779793.528676:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d3200/0x9e63ba8af688a498 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779793.528683:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d3200/0x9e63ba8af688a498 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779793.528690:0:14311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d3200/0x9e63ba8af688a498 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787779793.529159:0:14311:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787779793.529321:0:14311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d2400/0x9e63ba8af688a491 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779793.529330:0:14311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d2400/0x9e63ba8af688a491 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779793.529337:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d2400/0x9e63ba8af688a491 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779793.529344:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e7430d2400 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:2.0:1787779793.529348:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d2400/0x9e63ba8af688a491 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779793.529355:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d2400/0x9e63ba8af688a491 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779793.529369:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e87450ad00) 00010000:00010000:2.0:1787779793.529372:0:14311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787779793.529384:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d2400/0x9e63ba8af688a491 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779793.529390:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d2400/0x9e63ba8af688a491 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779793.529404:0:14311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d3200/0x9e63ba8af688a498 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779793.529411:0:14311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d3200/0x9e63ba8af688a498 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779793.529418:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d3200/0x9e63ba8af688a498 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779793.529423:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e7430d3200 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:2.0:1787779793.529426:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d3200/0x9e63ba8af688a498 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779793.529432:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d3200/0x9e63ba8af688a498 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779793.529440:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff98e846377800) 00010000:00010000:2.0:1787779793.529443:0:14311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787779793.529654:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d3200/0x9e63ba8af688a498 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779793.529663:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d3200/0x9e63ba8af688a498 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779793.529708:0:14311:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d2e00/0x9e63ba8af688a48a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb103 expref: 11 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779793.529999:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e87450ad00) 00010000:00010000:2.0:1787779793.530001:0:14311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787779793.530006:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d2e00/0x9e63ba8af688a48a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb103 expref: 11 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779793.530015:0:14311:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e7430d2e00, rc 0) 00000100:00100000:2.0:1787779793.530135:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a709e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9f07da6d-bdd3-44fa-ab17-edf321a3c5bb+10:14447:x1874622505144192:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 1647us (1905us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1787779793.530144:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 25 00000100:00100000:1.0:1787779793.543491:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779793.544326:0:16187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505144320 00000100:00100000:3.0:1787779793.544336:0:16187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505144320 00000100:00100000:3.0:1787779793.544399:0:16187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 26 00000100:00100000:3.0:1787779793.544409:0:16187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ece4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9f07da6d-bdd3-44fa-ab17-edf321a3c5bb+10:14447:x1874622505144320:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:3.0:1787779793.544433:0:16187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779793.544466:0:16187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af688a4a6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedb10a expref: -99 pid: 16187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779793.544571:0:16187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4200/0x9e63ba8af688a4ad lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779793.544585:0:16187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4200/0x9e63ba8af688a4ad lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779793.544596:0:16187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4200/0x9e63ba8af688a4ad lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787779793.544642:0:16187:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:3.0:1787779793.544646:0:16187:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787779793.544667:0:16187:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4200/0x9e63ba8af688a4ad lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779793.544690:0:16187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af688a4a6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb10a expref: 12 pid: 16187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779793.544752:0:16187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4200/0x9e63ba8af688a4ad lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb10a expref: 11 pid: 16187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779793.544763:0:16187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98e87450a400) 00010000:00010000:3.0:1787779793.544766:0:16187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787779793.544769:0:16187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e8429d4200, rc 0) 00000100:00100000:3.0:1787779793.544824:0:16187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ece4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9f07da6d-bdd3-44fa-ab17-edf321a3c5bb+11:14447:x1874622505144320:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 416us (1342us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779793.544832:0:16187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 26 00000100:00100000:2.0:1787779793.548828:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779793.548929:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505144448 00000100:00100000:1.0:1787779793.548947:0:14312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505144448 00000100:00100000:1.0:1787779793.549012:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 3 00000100:00100000:1.0:1787779793.549021:0:14312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e741e6cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9f07da6d-bdd3-44fa-ab17-edf321a3c5bb+11:14447:x1874622505144448:12345-192.168.201.9@tcp:37:lfs.0 00000100:00100000:1.0:1787779793.556151:0:14312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e741e6cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9f07da6d-bdd3-44fa-ab17-edf321a3c5bb+11:14447:x1874622505144448:12345-192.168.201.9@tcp:37:lfs.0 Request processed in 7119us (7331us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779793.556166:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 3 00000100:00100000:2.0:1787779793.567133:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779793.567408:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505144704 00000100:00100000:0.0:1787779793.567420:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505144704 00000100:00100000:0.0:1787779793.567494:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 4 00000100:00100000:0.0:1787779793.567504:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e85d93c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9f07da6d-bdd3-44fa-ab17-edf321a3c5bb+11:14447:x1874622505144704:12345-192.168.201.9@tcp:35:lfs.0 00000100:00100000:0.0:1787779793.567795:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e85d93c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9f07da6d-bdd3-44fa-ab17-edf321a3c5bb+12:14447:x1874622505144704:12345-192.168.201.9@tcp:35:lfs.0 Request processed in 291us (675us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1787779793.567803:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 4 00000100:00100000:2.0:1787779793.627841:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779793.627968:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505144832 00000100:00100000:0.0:1787779793.627979:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505144832 00000100:00100000:0.0:1787779793.628044:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 27 00000100:00100000:0.0:1787779793.628053:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e741e6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:43b382b8-5aec-409a-8dc5-84d259a200e7+10:14453:x1874622505144832:12345-192.168.201.9@tcp:101:bash.0 00010000:00010000:0.0:1787779793.628073:0:14309:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787779793.628093:0:14309:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68400/0x9e63ba8af688a4b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedb111 expref: -99 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779793.628169:0:14309:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af688a4bb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779793.628200:0:14309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af688a4bb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779793.628212:0:14309:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af688a4bb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779793.628229:0:14309:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af688a4c2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779793.628236:0:14309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af688a4c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779793.628243:0:14309:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af688a4c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779793.628345:0:14309:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69a00/0x9e63ba8af688a4c9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779793.628353:0:14309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69a00/0x9e63ba8af688a4c9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779793.628361:0:14309:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69a00/0x9e63ba8af688a4c9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787779793.628388:0:14309:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1787779793.628391:0:14309:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787779793.628427:0:14309:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69a00/0x9e63ba8af688a4c9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779793.628439:0:14309:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af688a4bb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779793.628465:0:14309:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af688a4bb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779793.628472:0:14309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af688a4bb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779793.628478:0:14309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e848f68000 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:0.0:1787779793.628482:0:14309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af688a4bb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779793.628490:0:14309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af688a4bb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779793.628502:0:14309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e87450ad00) 00010000:00010000:0.0:1787779793.628505:0:14309:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787779793.628509:0:14309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af688a4bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779793.628515:0:14309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af688a4bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779793.628528:0:14309:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af688a4c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779793.628534:0:14309:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af688a4c2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779793.628539:0:14309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af688a4c2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779793.628544:0:14309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e848f69800 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:0.0:1787779793.628551:0:14309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af688a4c2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779793.628557:0:14309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af688a4c2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779793.628564:0:14309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff98e860e78a00) 00010000:00010000:0.0:1787779793.628566:0:14309:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787779793.628568:0:14309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af688a4c2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779793.628574:0:14309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af688a4c2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779793.628607:0:14309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68400/0x9e63ba8af688a4b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb111 expref: 12 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779793.628619:0:14309:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69a00/0x9e63ba8af688a4c9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb111 expref: 11 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779793.628626:0:14309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98e87450a400) 00010000:00010000:0.0:1787779793.628628:0:14309:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787779793.628630:0:14309:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e848f69a00, rc 0) 00000100:00100000:0.0:1787779793.628691:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e741e6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:43b382b8-5aec-409a-8dc5-84d259a200e7+11:14453:x1874622505144832:12345-192.168.201.9@tcp:101:bash.0 Request processed in 639us (861us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779793.628699:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 27 00000100:00100000:2.0:1787779793.632921:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779793.633055:0:16187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505145088 00000100:00100000:3.0:1787779793.633066:0:16187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505145088 00000100:00100000:3.0:1787779793.633158:0:16187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 28 00000100:00100000:3.0:1787779793.633169:0:16187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e741e6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:43b382b8-5aec-409a-8dc5-84d259a200e7+11:14453:x1874622505145088:12345-192.168.201.9@tcp:101:bash.0 00010000:00010000:3.0:1787779793.633190:0:16187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779793.633210:0:16187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af688a4d0 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedb118 expref: -99 pid: 16187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779793.633350:0:16187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4a00/0x9e63ba8af688a4d7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779793.633366:0:16187:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4200/0x9e63ba8af688a4ad lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb10a expref: 11 pid: 16187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779793.633375:0:16187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4a00/0x9e63ba8af688a4d7 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779793.633408:0:16187:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4200/0x9e63ba8af688a4ad lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb10a expref: 11 pid: 16187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779793.633422:0:16187:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4200/0x9e63ba8af688a4ad lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb10a expref: 11 pid: 16187 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779793.633435:0:16187:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e74353ed00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16187:1874622525061504:192.168.201.9@tcp:104: 00000100:00100000:3.0:1787779793.633542:0:16187:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e86d5a8d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787779793.642180:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779793.643582:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505145216 00000100:00100000:0.0:1787779793.643595:0:14294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505145216 00010000:00010000:0.0:1787779793.643641:0:14294:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4200/0x9e63ba8af688a4ad lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb10a expref: 12 pid: 16187 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779793.643747:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 10 00000100:00100000:0.0:1787779793.643758:0:14294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e74353f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9f07da6d-bdd3-44fa-ab17-edf321a3c5bb+12:2360:x1874622505145216:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787779793.643774:0:14294:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787779793.643782:0:14294:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4200/0x9e63ba8af688a4ad lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb10a expref: 12 pid: 16187 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779793.643796:0:14294:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4200/0x9e63ba8af688a4ad lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb10a expref: 12 pid: 16187 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779793.643819:0:14294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98e87450a400) 00010000:00010000:0.0:1787779793.643824:0:14294:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4a00/0x9e63ba8af688a4d7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779793.643834:0:14294:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4a00/0x9e63ba8af688a4d7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779793.643842:0:14294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4a00/0x9e63ba8af688a4d7 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779793.643875:0:14294:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787779793.643940:0:14294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e74353f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9f07da6d-bdd3-44fa-ab17-edf321a3c5bb+12:2360:x1874622505145216:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 184us (1773us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779793.643947:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 10 00010000:00010000:1.0:1787779793.646450:0:16187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4200/0x9e63ba8af688a4ad lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb10a expref: 11 pid: 16187 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779793.646608:0:16187:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e74353ed00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16187:1874622525061504:192.168.201.9@tcp:104: 00010000:00010000:1.0:1787779793.646633:0:16187:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4a00/0x9e63ba8af688a4d7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779793.646644:0:16187:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4a00/0x9e63ba8af688a4d7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779793.646648:0:16187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4a00/0x9e63ba8af688a4d7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779793.646677:0:16187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94fa00/0x9e63ba8af688a4de lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779793.646689:0:16187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94fa00/0x9e63ba8af688a4de lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779793.646700:0:16187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94fa00/0x9e63ba8af688a4de lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779793.647677:0:16187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94e600/0x9e63ba8af688a4e5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779793.647706:0:16187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94e600/0x9e63ba8af688a4e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779793.647750:0:16187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94e600/0x9e63ba8af688a4e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787779793.647763:0:16187:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787779793.647795:0:16187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4a00/0x9e63ba8af688a4d7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779793.647803:0:16187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4a00/0x9e63ba8af688a4d7 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779793.647811:0:16187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4a00/0x9e63ba8af688a4d7 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779793.647817:0:16187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e8429d4a00 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:1.0:1787779793.647822:0:16187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4a00/0x9e63ba8af688a4d7 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779793.647830:0:16187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4a00/0x9e63ba8af688a4d7 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779793.647843:0:16187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98e87450a400) 00010000:00010000:1.0:1787779793.647847:0:16187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787779793.647853:0:16187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4a00/0x9e63ba8af688a4d7 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779793.647859:0:16187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4a00/0x9e63ba8af688a4d7 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787779793.647871:0:16187:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000155995d9 reply state 0000000064d6d638 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94fa00/0x9e63ba8af688a4de lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779793.647885:0:16187:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787779793.647940:0:16187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e8429d4400/0x9e63ba8af688a4d0 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb118 expref: 14 pid: 16187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779793.647956:0:16187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94e600/0x9e63ba8af688a4e5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb118 expref: 13 pid: 16187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779793.647963:0:16187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98e860e7e600) 00010000:00010000:1.0:1787779793.647966:0:16187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1787779793.647968:0:16187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87a94e600, rc 0) 00000100:00100000:1.0:1787779793.648056:0:16187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e741e6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:43b382b8-5aec-409a-8dc5-84d259a200e7+14:14453:x1874622505145088:12345-192.168.201.9@tcp:101:bash.0 Request processed in 14889us (15159us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1787779793.648066:0:16187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 28 00010000:00010000:1.0:1787779793.650401:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94fa00/0x9e63ba8af688a4de lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779793.650419:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94fa00/0x9e63ba8af688a4de lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779793.650427:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94fa00/0x9e63ba8af688a4de lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779793.650434:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87a94fa00 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:1.0:1787779793.650439:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94fa00/0x9e63ba8af688a4de lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779793.650447:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94fa00/0x9e63ba8af688a4de lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779793.650492:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff98e860e7ea00) 00010000:00010000:1.0:1787779793.650496:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787779793.650500:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94fa00/0x9e63ba8af688a4de lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779793.650506:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94fa00/0x9e63ba8af688a4de lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787779793.653293:0:14343:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787779793.665021:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779793.666058:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505145344 00000100:00100000:0.0:1787779793.666069:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505145344 00000100:00100000:0.0:1787779793.666184:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 29 00000100:00100000:0.0:1787779793.666195:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e74353e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:43b382b8-5aec-409a-8dc5-84d259a200e7+13:14453:x1874622505145344:12345-192.168.201.9@tcp:101:bash.0 00010000:00010000:0.0:1787779793.666245:0:14309:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787779793.666266:0:14309:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68400/0x9e63ba8af688a4f3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedb11f expref: -99 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779793.666338:0:14309:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af688a4fa lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779793.666354:0:14309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af688a4fa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779793.666366:0:14309:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af688a4fa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787779793.666408:0:14309:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787779793.666413:0:14309:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787779793.666430:0:14309:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af688a4fa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779793.666441:0:14309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af688a4fa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779793.666476:0:14309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68400/0x9e63ba8af688a4f3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb11f expref: 15 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779793.666495:0:14309:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af688a4fa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb11f expref: 14 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779793.666505:0:14309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98e860e7e600) 00010000:00010000:0.0:1787779793.666508:0:14309:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787779793.666511:0:14309:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e848f69800, rc 0) 00000100:00100000:0.0:1787779793.666594:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e74353e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:43b382b8-5aec-409a-8dc5-84d259a200e7+14:14453:x1874622505145344:12345-192.168.201.9@tcp:101:bash.0 Request processed in 401us (1586us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779793.666602:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 29 00000100:00100000:2.0:1787779793.674336:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779793.674423:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505145600 00000100:00100000:1.0:1787779793.674432:0:14312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505145600 00000100:00100000:0.0:1787779793.676348:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 5 00000100:00100000:0.0:1787779793.676373:0:14312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e741e6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:43b382b8-5aec-409a-8dc5-84d259a200e7+14:14453:x1874622505145600:12345-192.168.201.9@tcp:35:bash.0 00000100:00100000:0.0:1787779793.676794:0:14312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e741e6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:43b382b8-5aec-409a-8dc5-84d259a200e7+15:14453:x1874622505145600:12345-192.168.201.9@tcp:35:bash.0 Request processed in 433us (2559us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1787779793.676802:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 5 00000100:00100000:2.0:1787779793.767414:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779793.774106:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505145856 00000100:00100000:1.0:1787779793.774124:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505145856 00000100:00100000:1.0:1787779793.774206:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 30 00000100:00100000:1.0:1787779793.774217:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e741e6e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:43b382b8-5aec-409a-8dc5-84d259a200e7+15:14463:x1874622505145856:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:1.0:1787779793.774260:0:14310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779793.774283:0:14310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94e200/0x9e63ba8af688a501 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedb126 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787779793.774406:0:14310:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787779793.774549:0:14310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94e200/0x9e63ba8af688a501 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb126 expref: 17 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779793.774565:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e87450ad00) 00010000:00010000:1.0:1787779793.774568:0:14310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787779793.774574:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94e200/0x9e63ba8af688a501 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb126 expref: 17 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779793.774590:0:14310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87a94e200, rc 0) 00000100:00100000:1.0:1787779793.774836:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e741e6e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:43b382b8-5aec-409a-8dc5-84d259a200e7+16:14463:x1874622505145856:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 620us (7432us total) trans 8589934602 rc 301/301 00000100:00100000:1.0:1787779793.774844:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 30 00000100:00100000:1.0:1787779793.786426:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779793.786672:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505146112 00000100:00100000:3.0:1787779793.786693:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505146112 00000100:00100000:3.0:1787779793.786776:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 6 00000100:00100000:3.0:1787779793.786813:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ece7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:43b382b8-5aec-409a-8dc5-84d259a200e7+16:14463:x1874622505146112:12345-192.168.201.9@tcp:35:lfs.0 00000100:00100000:3.0:1787779793.787291:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ece7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:43b382b8-5aec-409a-8dc5-84d259a200e7+17:14463:x1874622505146112:12345-192.168.201.9@tcp:35:lfs.0 Request processed in 482us (875us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1787779793.787300:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 6 00000100:00100000:0.0:1787779793.843220:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e74353cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622525061632:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787779793.843304:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779793.847418:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525061632 00000100:00100000:3.0:1787779793.847435:0:14996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525061632 00000100:00100000:3.0:1787779793.847508:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787779793.847518:0:14996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a708780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622525061632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787779793.847555:0:14996:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787779793.847636:0:14996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a708780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874622525061632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (4332us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779793.847644:0:14996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787779793.847834:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e74353cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622525061632:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787779793.881162:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779793.881275:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505146368 00000100:00100000:1.0:1787779793.881285:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505146368 00000100:00100000:1.0:1787779793.881349:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 31 00000100:00100000:1.0:1787779793.881360:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e74353c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:43b382b8-5aec-409a-8dc5-84d259a200e7+17:14466:x1874622505146368:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:1.0:1787779793.881385:0:14311:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779793.881405:0:14311:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94e200/0x9e63ba8af688a50f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedb12d expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779793.881692:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94fe00/0x9e63ba8af688a516 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779793.881743:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94fe00/0x9e63ba8af688a516 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779793.881756:0:14311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94fe00/0x9e63ba8af688a516 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787779793.881767:0:14311:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787779793.881959:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94e200/0x9e63ba8af688a50f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb12d expref: 20 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779793.881978:0:14311:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94fe00/0x9e63ba8af688a516 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb12d expref: 19 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779793.882004:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98e860e7e600) 00010000:00010000:1.0:1787779793.882007:0:14311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787779793.882011:0:14311:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87a94fe00, rc 0) 00000100:00100000:1.0:1787779793.882113:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e74353c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:43b382b8-5aec-409a-8dc5-84d259a200e7+19:14466:x1874622505146368:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 755us (961us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1787779793.882121:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 31 00000100:00100000:3.0:1787779793.906202:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779793.906253:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779793.906291:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505146496 00000100:00100000:3.0:1787779793.906303:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505146496 00000100:00100000:3.0:1787779793.906376:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 0 00000100:00100000:3.0:1787779793.906388:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e74353e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:43b382b8-5aec-409a-8dc5-84d259a200e7+19:2358:x1874622505146496:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787779793.906405:0:14296:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787779793.906438:0:14296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94fe00/0x9e63ba8af688a516 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb12d expref: 19 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779793.906459:0:14296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98e860e7e600) 00010000:00010000:3.0:1787779793.906464:0:14296:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787779793.906519:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e74353e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:43b382b8-5aec-409a-8dc5-84d259a200e7+18:2358:x1874622505146496:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 134us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779793.906538:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 0 00000100:00100000:0.0:1787779793.906747:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505146624 00000100:00100000:0.0:1787779793.906752:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505146624 00000100:00100000:0.0:1787779793.906783:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 32 00000100:00100000:0.0:1787779793.906791:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e74353f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:43b382b8-5aec-409a-8dc5-84d259a200e7+18:14466:x1874622505146624:12345-192.168.201.9@tcp:54:lfs.0 00010000:00010000:0.0:1787779793.906860:0:14310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68400/0x9e63ba8af688a524 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779793.906876:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68400/0x9e63ba8af688a524 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779793.906888:0:14310:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68400/0x9e63ba8af688a524 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779793.906930:0:14310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68400/0x9e63ba8af688a524 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779793.906937:0:14310:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68400/0x9e63ba8af688a524 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779793.906957:0:14310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68400/0x9e63ba8af688a524 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779793.906963:0:14310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e848f68400 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:0.0:1787779793.906969:0:14310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68400/0x9e63ba8af688a524 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779793.906977:0:14310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68400/0x9e63ba8af688a524 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779793.906985:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98e860e7e600) 00010000:00010000:0.0:1787779793.906988:0:14310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787779793.906993:0:14310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68400/0x9e63ba8af688a524 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779793.907000:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68400/0x9e63ba8af688a524 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779793.907047:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e74353f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:43b382b8-5aec-409a-8dc5-84d259a200e7+18:14466:x1874622505146624:12345-192.168.201.9@tcp:54:lfs.0 Request processed in 257us (856us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779793.907055:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 32 00000100:00100000:3.0:1787779793.910846:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779793.910997:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505146880 00000100:00100000:0.0:1787779793.911008:0:14312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505146880 00000100:00100000:0.0:1787779793.911073:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 7 00000100:00100000:0.0:1787779793.911086:0:14312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e74353d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:43b382b8-5aec-409a-8dc5-84d259a200e7+18:14466:x1874622505146880:12345-192.168.201.9@tcp:35:lfs.0 00000100:00100000:0.0:1787779793.911346:0:14312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e74353d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:43b382b8-5aec-409a-8dc5-84d259a200e7+19:14466:x1874622505146880:12345-192.168.201.9@tcp:35:lfs.0 Request processed in 262us (508us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1787779793.911355:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 7 00000001:00080000:1.0:1787779793.938682:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934601 is committed 00000001:00080000:1.0:1787779793.938703:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000001:00080000:1.0:1787779793.939677:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934602 is committed 00000001:00080000:1.0:1787779793.939700:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934603 is committed 00000100:00100000:3.0:1787779794.237549:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779794.237657:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505147136 00000100:00100000:0.0:1787779794.237667:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505147136 00000100:00100000:0.0:1787779794.237779:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 33 00000100:00100000:0.0:1787779794.237797:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e74353de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:43b382b8-5aec-409a-8dc5-84d259a200e7+13:14497:x1874622505147136:12345-192.168.201.9@tcp:101:cat.0 00010000:00010000:0.0:1787779794.237822:0:14309:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787779794.237841:0:14309:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68400/0x9e63ba8af688a52b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedb134 expref: -99 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779794.237951:0:14309:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af688a532 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779794.237965:0:14309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af688a532 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779794.237976:0:14309:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af688a532 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787779794.237987:0:14309:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787779794.238126:0:14309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68400/0x9e63ba8af688a52b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb134 expref: 16 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779794.238143:0:14309:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af688a532 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb134 expref: 15 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779794.238150:0:14309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98e860e7e600) 00010000:00010000:0.0:1787779794.238153:0:14309:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787779794.238156:0:14309:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e848f68000, rc 0) 00000100:00100000:0.0:1787779794.238216:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e74353de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:43b382b8-5aec-409a-8dc5-84d259a200e7+15:14497:x1874622505147136:12345-192.168.201.9@tcp:101:cat.0 Request processed in 429us (676us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1787779794.238238:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 33 00000100:00100000:3.0:1787779794.243808:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779794.243923:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505147392 00000100:00100000:0.0:1787779794.243933:0:14312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505147392 00000100:00100000:0.0:1787779794.244003:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 8 00000100:00100000:0.0:1787779794.244014:0:14312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e74353fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:43b382b8-5aec-409a-8dc5-84d259a200e7+15:14497:x1874622505147392:12345-192.168.201.9@tcp:35:cat.0 00000100:00100000:0.0:1787779794.244403:0:14312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e74353fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:43b382b8-5aec-409a-8dc5-84d259a200e7+16:14497:x1874622505147392:12345-192.168.201.9@tcp:35:cat.0 Request processed in 389us (616us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1787779794.244411:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 8 00000100:00100000:3.0:1787779794.248331:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779794.248967:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505147520 00000100:00100000:2.0:1787779794.248978:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505147520 00000100:00100000:2.0:1787779794.249049:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 1 00000100:00100000:2.0:1787779794.249059:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e74353d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:43b382b8-5aec-409a-8dc5-84d259a200e7+16:2357:x1874622505147520:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787779794.249075:0:14295:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787779794.249099:0:14295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68000/0x9e63ba8af688a532 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb134 expref: 16 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779794.249117:0:14295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98e860e7e600) 00010000:00010000:2.0:1787779794.249122:0:14295:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787779794.249204:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e74353d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:43b382b8-5aec-409a-8dc5-84d259a200e7+15:2357:x1874622505147520:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 146us (883us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779794.249212:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 1 00000100:00100000:1.0:1787779794.344139:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779794.344242:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505147776 00000100:00100000:0.0:1787779794.344253:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505147776 00000100:00100000:0.0:1787779794.344316:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 34 00000100:00100000:0.0:1787779794.344326:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ece61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:43b382b8-5aec-409a-8dc5-84d259a200e7+15:14503:x1874622505147776:12345-192.168.201.9@tcp:101:dd.0 00010000:00010000:0.0:1787779794.344352:0:14310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787779794.344373:0:14310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69000/0x9e63ba8af688a540 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedb13b expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779794.344481:0:14310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68c00/0x9e63ba8af688a547 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779794.344495:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68c00/0x9e63ba8af688a547 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779794.344510:0:14310:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68c00/0x9e63ba8af688a547 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787779794.344520:0:14310:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787779794.344690:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69000/0x9e63ba8af688a540 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb13b expref: 18 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779794.344761:0:14310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68c00/0x9e63ba8af688a547 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb13b expref: 17 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779794.344770:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98e860e7e600) 00010000:00010000:0.0:1787779794.344773:0:14310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787779794.344776:0:14310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e848f68c00, rc 0) 00000100:00100000:0.0:1787779794.344858:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ece61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:43b382b8-5aec-409a-8dc5-84d259a200e7+17:14503:x1874622505147776:12345-192.168.201.9@tcp:101:dd.0 Request processed in 533us (730us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1787779794.344866:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 34 00000100:00100000:0.0:1787779794.349806:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779794.350148:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505148032 00000100:00100000:3.0:1787779794.350158:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505148032 00000100:00100000:3.0:1787779794.350222:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 35 00000100:00100000:3.0:1787779794.350234:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a70b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:43b382b8-5aec-409a-8dc5-84d259a200e7+17:14503:x1874622505148032:12345-192.168.201.9@tcp:36:dd.0 00010000:00010000:3.0:1787779794.350292:0:14309:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1787779794.350320:0:14309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68c00/0x9e63ba8af688a547 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb13b expref: 17 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779794.350342:0:14309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af688a4fa lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb11f expref: 16 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779794.350352:0:14309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98e860e7e600) 00010000:00010000:3.0:1787779794.350358:0:14309:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787779794.350559:0:14309:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a000/0x9e63ba8af688a555 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779794.350573:0:14309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a000/0x9e63ba8af688a555 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779794.350583:0:14309:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a000/0x9e63ba8af688a555 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787779794.350632:0:14309:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:3.0:1787779794.350684:0:14309:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000be2814d2 reply state 000000000d0c7d66 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a000/0x9e63ba8af688a555 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779794.350694:0:14309:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787779794.350917:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a70b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:43b382b8-5aec-409a-8dc5-84d259a200e7+18:14503:x1874622505148032:12345-192.168.201.9@tcp:36:dd.0 Request processed in 685us (1129us total) trans 8589934610 rc 0/0 00000100:00100000:3.0:1787779794.350925:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 35 00000020:00080000:3.0:1787779794.350929:0:14309:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787779794.353329:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a000/0x9e63ba8af688a555 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779794.353345:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a000/0x9e63ba8af688a555 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779794.353352:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a000/0x9e63ba8af688a555 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779794.353358:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87a98a000 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:0.0:1787779794.353363:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a000/0x9e63ba8af688a555 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779794.353372:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a000/0x9e63ba8af688a555 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779794.353386:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98e860e7e600) 00010000:00010000:0.0:1787779794.353389:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787779794.353407:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a000/0x9e63ba8af688a555 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779794.353413:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a000/0x9e63ba8af688a555 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779794.421735:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779794.422500:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779794.422658:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505148288 00000100:00100000:2.0:1787779794.422668:0:14312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505148288 00000100:00100000:2.0:1787779794.422760:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 9 00000100:00100000:2.0:1787779794.422771:0:14312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a70a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:43b382b8-5aec-409a-8dc5-84d259a200e7+17:14503:x1874622505148288:12345-192.168.201.9@tcp:35:dd.0 00000100:00100000:2.0:1787779794.423192:0:14312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a70a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:43b382b8-5aec-409a-8dc5-84d259a200e7+18:14503:x1874622505148288:12345-192.168.201.9@tcp:35:dd.0 Request processed in 423us (699us total) trans 8589934611 rc 0/0 00000100:00100000:2.0:1787779794.423201:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 9 00000100:00100000:2.0:1787779794.575168:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779794.575326:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505148416 00000100:00100000:0.0:1787779794.575337:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505148416 00000100:00100000:0.0:1787779794.575403:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 36 00000100:00100000:0.0:1787779794.575414:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e741e6ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:43b382b8-5aec-409a-8dc5-84d259a200e7+18:14517:x1874622505148416:12345-192.168.201.9@tcp:101:stat.0 00010000:00010000:0.0:1787779794.575439:0:14310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787779794.575460:0:14310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69e00/0x9e63ba8af688a55c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedb142 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779794.575529:0:14310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af688a563 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779794.575545:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af688a563 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779794.575557:0:14310:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af688a563 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779794.575574:0:14310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af688a56a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779794.575582:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af688a56a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779794.575588:0:14310:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af688a56a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779794.576132:0:14310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68c00/0x9e63ba8af688a571 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779794.576144:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68c00/0x9e63ba8af688a571 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779794.576153:0:14310:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68c00/0x9e63ba8af688a571 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787779794.576191:0:14310:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787779794.576195:0:14310:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787779794.576239:0:14310:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68c00/0x9e63ba8af688a571 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779794.576252:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68c00/0x9e63ba8af688a571 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779794.576260:0:14310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af688a563 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779794.576266:0:14310:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af688a563 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779794.576273:0:14310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af688a563 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779794.576279:0:14310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e848f69600 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:0.0:1787779794.576283:0:14310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af688a563 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779794.576290:0:14310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af688a563 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779794.576309:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98e87450a400) 00010000:00010000:0.0:1787779794.576313:0:14310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787779794.576318:0:14310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af688a563 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779794.576324:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af688a563 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779794.576337:0:14310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af688a56a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779794.576343:0:14310:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af688a56a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779794.576349:0:14310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af688a56a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779794.576354:0:14310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e848f69800 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:0.0:1787779794.576357:0:14310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af688a56a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779794.576364:0:14310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af688a56a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779794.576371:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff98e860e78a00) 00010000:00010000:0.0:1787779794.576373:0:14310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787779794.576376:0:14310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af688a56a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779794.576382:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af688a56a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779794.576425:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69e00/0x9e63ba8af688a55c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb142 expref: 20 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779794.576438:0:14310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68c00/0x9e63ba8af688a571 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb142 expref: 19 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779794.576446:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98e860e7e600) 00010000:00010000:0.0:1787779794.576448:0:14310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787779794.576451:0:14310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e848f68c00, rc 0) 00000100:00100000:0.0:1787779794.576536:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e741e6ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:43b382b8-5aec-409a-8dc5-84d259a200e7+19:14517:x1874622505148416:12345-192.168.201.9@tcp:101:stat.0 Request processed in 1124us (1378us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779794.576545:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 36 00000100:00100000:0.0:1787779794.645155:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779794.645249:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505148672 00000100:00100000:3.0:1787779794.645262:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505148672 00000100:00100000:3.0:1787779794.645326:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 37 00000100:00100000:3.0:1787779794.645337:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a70b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:43b382b8-5aec-409a-8dc5-84d259a200e7+19:14523:x1874622505148672:12345-192.168.201.9@tcp:36:truncate.0 00010000:00010000:3.0:1787779794.645398:0:14309:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787779794.645426:0:14309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f68c00/0x9e63ba8af688a571 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb142 expref: 19 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779794.645447:0:14309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98e860e7e600) 00010000:00010000:3.0:1787779794.645452:0:14309:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787779794.645678:0:14309:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af688a578 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779794.645694:0:14309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af688a578 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779794.645703:0:14309:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af688a578 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787779794.645812:0:14309:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:3.0:1787779794.645851:0:14309:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c14cc9b2 reply state 0000000092b1989e transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af688a578 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779794.645879:0:14309:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787779794.646018:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a70b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:43b382b8-5aec-409a-8dc5-84d259a200e7+21:14523:x1874622505148672:12345-192.168.201.9@tcp:36:truncate.0 Request processed in 682us (870us total) trans 8589934613 rc 0/0 00000100:00100000:3.0:1787779794.646026:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 37 00000020:00080000:3.0:1787779794.646031:0:14309:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787779794.649157:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af688a578 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779794.649173:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af688a578 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779794.649182:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af688a578 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779794.649188:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87a98b600 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:3.0:1787779794.649193:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af688a578 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779794.649201:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af688a578 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779794.649219:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98e860e7e600) 00010000:00010000:3.0:1787779794.649222:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779794.649227:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af688a578 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779794.649234:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af688a578 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779794.796339:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779794.796445:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505148800 00000100:00100000:1.0:1787779794.796456:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505148800 00000100:00100000:1.0:1787779794.796521:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 38 00000100:00100000:1.0:1787779794.796531:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a70a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:43b382b8-5aec-409a-8dc5-84d259a200e7+20:14537:x1874622505148800:12345-192.168.201.9@tcp:101:stat.0 00010000:00010000:1.0:1787779794.796557:0:14310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779794.796577:0:14310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94ee00/0x9e63ba8af688a57f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedb149 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779794.796643:0:14310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94f000/0x9e63ba8af688a586 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779794.796657:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94f000/0x9e63ba8af688a586 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779794.796668:0:14310:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94f000/0x9e63ba8af688a586 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779794.796697:0:14310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94f800/0x9e63ba8af688a58d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779794.796704:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94f800/0x9e63ba8af688a58d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779794.796748:0:14310:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94f800/0x9e63ba8af688a58d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779794.797125:0:14310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94f600/0x9e63ba8af688a594 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779794.797135:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94f600/0x9e63ba8af688a594 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779794.797143:0:14310:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94f600/0x9e63ba8af688a594 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787779794.797178:0:14310:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:1.0:1787779794.797183:0:14310:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787779794.797205:0:14310:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94f600/0x9e63ba8af688a594 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779794.797217:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94f600/0x9e63ba8af688a594 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779794.797225:0:14310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94f000/0x9e63ba8af688a586 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779794.797232:0:14310:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94f000/0x9e63ba8af688a586 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779794.797250:0:14310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94f000/0x9e63ba8af688a586 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779794.797257:0:14310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87a94f000 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:1.0:1787779794.797261:0:14310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94f000/0x9e63ba8af688a586 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779794.797268:0:14310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94f000/0x9e63ba8af688a586 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779794.797280:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98e87450a400) 00010000:00010000:1.0:1787779794.797283:0:14310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787779794.797287:0:14310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94f000/0x9e63ba8af688a586 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779794.797294:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94f000/0x9e63ba8af688a586 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779794.797307:0:14310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94f800/0x9e63ba8af688a58d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779794.797312:0:14310:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94f800/0x9e63ba8af688a58d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779794.797318:0:14310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94f800/0x9e63ba8af688a58d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779794.797323:0:14310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87a94f800 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:1.0:1787779794.797325:0:14310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94f800/0x9e63ba8af688a58d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779794.797341:0:14310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94f800/0x9e63ba8af688a58d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779794.797349:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff98e860e7ea00) 00010000:00010000:1.0:1787779794.797352:0:14310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787779794.797355:0:14310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94f800/0x9e63ba8af688a58d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779794.797361:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94f800/0x9e63ba8af688a58d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779794.797393:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94ee00/0x9e63ba8af688a57f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb149 expref: 22 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779794.797406:0:14310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94f600/0x9e63ba8af688a594 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb149 expref: 21 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779794.797414:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98e860e7e600) 00010000:00010000:1.0:1787779794.797416:0:14310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787779794.797419:0:14310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87a94f600, rc 0) 00000100:00100000:1.0:1787779794.797497:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a70a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:43b382b8-5aec-409a-8dc5-84d259a200e7+21:14537:x1874622505148800:12345-192.168.201.9@tcp:101:stat.0 Request processed in 968us (1169us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779794.797506:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 38 00000100:00100000:1.0:1787779794.912512:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779794.916747:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505149056 00000100:00100000:3.0:1787779794.916778:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505149056 00000100:00100000:3.0:1787779794.917036:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 39 00000100:00100000:3.0:1787779794.917046:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ece7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:43b382b8-5aec-409a-8dc5-84d259a200e7+21:14547:x1874622505149056:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:3.0:1787779794.917067:0:14309:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779794.917087:0:14309:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af688a59b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedb150 expref: -99 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787779794.918081:0:14309:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1787779794.918345:0:14309:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af688a59b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb150 expref: 23 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779794.918361:0:14309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e87450ad00) 00010000:00010000:3.0:1787779794.918364:0:14309:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787779794.918369:0:14309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af688a59b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb150 expref: 23 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779794.918382:0:14309:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87a98b600, rc 0) 00000100:00100000:3.0:1787779794.918457:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ece7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:43b382b8-5aec-409a-8dc5-84d259a200e7+22:14547:x1874622505149056:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 1412us (5952us total) trans 8589934614 rc 301/301 00000100:00100000:3.0:1787779794.918465:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 39 00000100:00100000:0.0:1787779794.928818:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779794.929044:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505149312 00000100:00100000:3.0:1787779794.929054:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505149312 00000100:00100000:3.0:1787779794.929113:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 10 00000100:00100000:3.0:1787779794.929124:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e842e99c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:43b382b8-5aec-409a-8dc5-84d259a200e7+22:14547:x1874622505149312:12345-192.168.201.9@tcp:35:lfs.0 00000100:00100000:3.0:1787779794.930134:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e842e99c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:43b382b8-5aec-409a-8dc5-84d259a200e7+23:14547:x1874622505149312:12345-192.168.201.9@tcp:35:lfs.0 Request processed in 1007us (1322us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1787779794.930147:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 10 00000100:00100000:0.0:1787779795.003432:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779795.003543:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505149568 00000100:00100000:1.0:1787779795.003553:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505149568 00000100:00100000:1.0:1787779795.003682:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 40 00000100:00100000:1.0:1787779795.003692:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a708b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:43b382b8-5aec-409a-8dc5-84d259a200e7+23:14553:x1874622505149568:12345-192.168.201.9@tcp:101:bash.0 00010000:00010000:1.0:1787779795.003754:0:14310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779795.003988:0:14310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94f800/0x9e63ba8af688a5a9 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedb157 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779795.004074:0:14310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94f000/0x9e63ba8af688a5b0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779795.004085:0:14310:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94e600/0x9e63ba8af688a4e5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb118 expref: 24 pid: 16187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779795.004090:0:14310:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94f600/0x9e63ba8af688a594 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb149 expref: 24 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779795.004096:0:14310:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94f000/0x9e63ba8af688a5b0 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779795.004120:0:14310:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94f600/0x9e63ba8af688a594 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb149 expref: 24 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779795.004129:0:14310:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94f600/0x9e63ba8af688a594 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb149 expref: 24 pid: 14310 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779795.004139:0:14310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ece4b40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14310:1874622525061760:192.168.201.9@tcp:104: 00010000:00010000:1.0:1787779795.004222:0:14310:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94e600/0x9e63ba8af688a4e5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb118 expref: 24 pid: 16187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779795.004228:0:14310:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94e600/0x9e63ba8af688a4e5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb118 expref: 24 pid: 16187 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779795.004244:0:14310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ece6580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14310:1874622525061888:192.168.201.9@tcp:104: 00000100:00100000:1.0:1787779795.004262:0:14310:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e847472000 going to sleep for 11 seconds 00000100:00080000:3.0:1787779795.005676:0:14305:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787779795.006378:0:14310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ece4b40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14310:1874622525061760:192.168.201.9@tcp:104: 00000100:00100000:0.0:1787779795.006392:0:14310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ece6580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14310:1874622525061888:192.168.201.9@tcp:104: 00010000:00010000:0.0:1787779795.006415:0:14310:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94f000/0x9e63ba8af688a5b0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779795.007363:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779795.007402:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779795.007480:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505149824 00000100:00100000:2.0:1787779795.007487:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505149824 00010000:00010000:2.0:1787779795.007528:0:14295:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94e600/0x9e63ba8af688a4e5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb118 expref: 25 pid: 16187 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779795.007556:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505149696 00000100:00100000:2.0:1787779795.007558:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505149696 00010000:00010000:2.0:1787779795.007566:0:14295:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94f600/0x9e63ba8af688a594 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb149 expref: 26 pid: 14310 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779795.007575:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 11 00000100:00100000:2.0:1787779795.007580:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87f02e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:43b382b8-5aec-409a-8dc5-84d259a200e7+26:2359:x1874622505149824:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787779795.007592:0:14295:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787779795.007597:0:14295:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94e600/0x9e63ba8af688a4e5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb118 expref: 26 pid: 16187 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779795.007619:0:14295:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94e600/0x9e63ba8af688a4e5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb118 expref: 26 pid: 16187 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779795.007636:0:14295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94e600/0x9e63ba8af688a4e5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb118 expref: 26 pid: 16187 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779795.007648:0:14295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98e860e7e600) 00010000:00010000:2.0:1787779795.007651:0:14295:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94f000/0x9e63ba8af688a5b0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779795.007658:0:14295:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94f000/0x9e63ba8af688a5b0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779795.007663:0:14295:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787779795.007755:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87f02e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:43b382b8-5aec-409a-8dc5-84d259a200e7+25:2359:x1874622505149824:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 173us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779795.007763:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 11 00000100:00100000:2.0:1787779795.007822:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 12 00000100:00100000:2.0:1787779795.007829:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a70ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:43b382b8-5aec-409a-8dc5-84d259a200e7+24:2359:x1874622505149696:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787779795.007849:0:14295:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787779795.007855:0:14295:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94f600/0x9e63ba8af688a594 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb149 expref: 24 pid: 14310 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779795.007865:0:14295:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94f600/0x9e63ba8af688a594 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb149 expref: 24 pid: 14310 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779795.007897:0:14295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94f600/0x9e63ba8af688a594 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb149 expref: 24 pid: 14310 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779795.007908:0:14295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98e860e7e600) 00010000:00010000:2.0:1787779795.007911:0:14295:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94f000/0x9e63ba8af688a5b0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779795.007918:0:14295:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94f000/0x9e63ba8af688a5b0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779795.007925:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94f000/0x9e63ba8af688a5b0 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779795.007944:0:14295:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787779795.007963:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a70ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:43b382b8-5aec-409a-8dc5-84d259a200e7+23:2359:x1874622505149696:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 135us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779795.007970:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 12 00010000:00010000:0.0:1787779795.008665:0:14310:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94f000/0x9e63ba8af688a5b0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779795.008687:0:14310:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94f000/0x9e63ba8af688a5b0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787779795.008706:0:14310:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:0.0:1787779795.008882:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94f800/0x9e63ba8af688a5a9 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb157 expref: 24 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779795.008906:0:14310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94f000/0x9e63ba8af688a5b0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb157 expref: 23 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779795.008915:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98e860e7e600) 00010000:00010000:0.0:1787779795.008918:0:14310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787779795.008925:0:14310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87a94f000, rc 0) 00000100:00100000:0.0:1787779795.008971:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a708b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:43b382b8-5aec-409a-8dc5-84d259a200e7+23:14553:x1874622505149568:12345-192.168.201.9@tcp:101:bash.0 Request processed in 5281us (5549us total) trans 8589934616 rc 0/0 00000100:00100000:0.0:1787779795.008979:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 40 00000100:00100000:0.0:1787779795.011448:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779795.012023:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505150080 00000100:00100000:1.0:1787779795.012033:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505150080 00000100:00100000:1.0:1787779795.012094:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 41 00000100:00100000:1.0:1787779795.012104:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a708000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:43b382b8-5aec-409a-8dc5-84d259a200e7+23:14553:x1874622505150080:12345-192.168.201.9@tcp:36:bash.0 00010000:00010000:1.0:1787779795.012348:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94fa00/0x9e63ba8af688a5be lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779795.012365:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94fa00/0x9e63ba8af688a5be lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779795.012376:0:14311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94fa00/0x9e63ba8af688a5be lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787779795.012429:0:14311:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:1.0:1787779795.012454:0:14311:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008f06f79d reply state 000000006a3363d1 transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94fa00/0x9e63ba8af688a5be lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779795.012463:0:14311:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787779795.012619:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a708000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:43b382b8-5aec-409a-8dc5-84d259a200e7+26:14553:x1874622505150080:12345-192.168.201.9@tcp:36:bash.0 Request processed in 516us (1180us total) trans 8589934618 rc 0/0 00000100:00100000:1.0:1787779795.012627:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 41 00000020:00080000:1.0:1787779795.012632:0:14311:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787779795.015354:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779795.015762:0:16187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505150208 00000100:00100000:2.0:1787779795.015778:0:16187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505150208 00000100:00100000:2.0:1787779795.015836:0:16187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 42 00000100:00100000:2.0:1787779795.015845:0:16187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ece6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:43b382b8-5aec-409a-8dc5-84d259a200e7+26:14553:x1874622505150208:12345-192.168.201.9@tcp:101:bash.0 00010000:00010000:2.0:1787779795.015867:0:16187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779795.015886:0:16187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d2800/0x9e63ba8af688a5c5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedb15e expref: -99 pid: 16187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779795.015949:0:16187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d2800/0x9e63ba8af688a5c5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb15e expref: 27 pid: 16187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779795.015980:0:16187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d2800/0x9e63ba8af688a5c5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb15e expref: 27 pid: 16187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779795.015998:0:16187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98e860e7e600) 00010000:00010000:2.0:1787779795.016001:0:16187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787779795.016004:0:16187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e7430d2800, rc 0) 00000100:00100000:2.0:1787779795.016091:0:16187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ece6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:43b382b8-5aec-409a-8dc5-84d259a200e7+27:14553:x1874622505150208:12345-192.168.201.9@tcp:101:bash.0 Request processed in 247us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779795.016098:0:16187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 42 00010000:00010000:0.0:1787779795.016279:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94fa00/0x9e63ba8af688a5be lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779795.016288:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94fa00/0x9e63ba8af688a5be lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779795.016295:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94fa00/0x9e63ba8af688a5be lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779795.016302:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87a94fa00 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:0.0:1787779795.016306:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94fa00/0x9e63ba8af688a5be lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779795.016321:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94fa00/0x9e63ba8af688a5be lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779795.016334:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98e860e7e600) 00010000:00010000:0.0:1787779795.016336:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787779795.016340:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94fa00/0x9e63ba8af688a5be lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779795.016346:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94fa00/0x9e63ba8af688a5be lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779795.021270:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779795.021355:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505150336 00000100:00100000:1.0:1787779795.021364:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505150336 00000100:00100000:1.0:1787779795.021424:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 43 00000100:00100000:1.0:1787779795.021448:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a709680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:43b382b8-5aec-409a-8dc5-84d259a200e7+26:14553:x1874622505150336:12345-192.168.201.9@tcp:101:bash.0 00010000:00010000:1.0:1787779795.021468:0:14311:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779795.021487:0:14311:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94fc00/0x9e63ba8af688a5cc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedb165 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779795.021572:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94e000/0x9e63ba8af688a5d3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779795.021585:0:14311:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94f000/0x9e63ba8af688a5b0 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb157 expref: 27 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779795.021593:0:14311:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94e000/0x9e63ba8af688a5d3 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779795.021621:0:14311:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94f000/0x9e63ba8af688a5b0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb157 expref: 27 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779795.021632:0:14311:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94f000/0x9e63ba8af688a5b0 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb157 expref: 27 pid: 14310 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779795.021644:0:14311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ece43c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14311:1874622525062016:192.168.201.9@tcp:104: 00000100:00100000:1.0:1787779795.021751:0:14311:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e847472000 going to sleep for 11 seconds 00000100:00100000:3.0:1787779795.024523:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779795.024588:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505150464 00000100:00100000:2.0:1787779795.024596:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505150464 00010000:00010000:2.0:1787779795.024629:0:14295:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94f000/0x9e63ba8af688a5b0 lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb157 expref: 28 pid: 14310 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779795.024659:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 13 00000100:00100000:2.0:1787779795.024665:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e74353d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:43b382b8-5aec-409a-8dc5-84d259a200e7+28:2359:x1874622505150464:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787779795.024678:0:14295:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787779795.024683:0:14295:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94f000/0x9e63ba8af688a5b0 lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb157 expref: 28 pid: 14310 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779795.024693:0:14295:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94f000/0x9e63ba8af688a5b0 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb157 expref: 28 pid: 14310 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779795.024739:0:14295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98e860e7e600) 00010000:00010000:2.0:1787779795.024742:0:14295:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94e000/0x9e63ba8af688a5d3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779795.024761:0:14295:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94e000/0x9e63ba8af688a5d3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779795.024767:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94e000/0x9e63ba8af688a5d3 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779795.024787:0:14295:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787779795.024826:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e74353d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:43b382b8-5aec-409a-8dc5-84d259a200e7+28:2359:x1874622505150464:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 161us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779795.024832:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 13 00010000:00010000:1.0:1787779795.024979:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94f000/0x9e63ba8af688a5b0 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb157 expref: 27 pid: 14310 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779795.024995:0:14311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ece43c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14311:1874622525062016:192.168.201.9@tcp:104: 00010000:00010000:1.0:1787779795.025017:0:14311:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94e000/0x9e63ba8af688a5d3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779795.025035:0:14311:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94e000/0x9e63ba8af688a5d3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779795.025041:0:14311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94e000/0x9e63ba8af688a5d3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787779795.025085:0:14311:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1787779795.025090:0:14311:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787779795.025110:0:14311:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94e000/0x9e63ba8af688a5d3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779795.025149:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94fc00/0x9e63ba8af688a5cc lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb165 expref: 27 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779795.025162:0:14311:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94e000/0x9e63ba8af688a5d3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb165 expref: 26 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779795.025169:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98e860e7e600) 00010000:00010000:1.0:1787779795.025172:0:14311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787779795.025175:0:14311:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87a94e000, rc 0) 00000100:00100000:1.0:1787779795.025211:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a709680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:43b382b8-5aec-409a-8dc5-84d259a200e7+26:14553:x1874622505150336:12345-192.168.201.9@tcp:101:bash.0 Request processed in 3765us (3951us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779795.025218:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 43 00000100:00100000:3.0:1787779795.027866:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779795.028005:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505150720 00000100:00100000:0.0:1787779795.028014:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505150720 00000100:00100000:0.0:1787779795.028071:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 2 00000100:00100000:0.0:1787779795.028081:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e74353fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:43b382b8-5aec-409a-8dc5-84d259a200e7+26:14553:x1874622505150720:12345-192.168.201.9@tcp:103:bash.0 00010000:00010000:0.0:1787779795.028097:0:14296:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1787779795.028118:0:14296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94e000/0x9e63ba8af688a5d3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb165 expref: 26 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779795.028133:0:14296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d2800/0x9e63ba8af688a5c5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb15e expref: 25 pid: 16187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779795.028141:0:14296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98e860e7e600) 00010000:00010000:0.0:1787779795.028150:0:14296:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787779795.028195:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e74353fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:43b382b8-5aec-409a-8dc5-84d259a200e7+24:14553:x1874622505150720:12345-192.168.201.9@tcp:103:bash.0 Request processed in 116us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779795.028203:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 2 00000100:00100000:0.0:1787779795.029703:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779795.029927:0:16187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505150848 00000100:00100000:2.0:1787779795.029936:0:16187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505150848 00000100:00100000:2.0:1787779795.029981:0:16187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 44 00000100:00100000:2.0:1787779795.029988:0:16187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87a70a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:43b382b8-5aec-409a-8dc5-84d259a200e7+24:14553:x1874622505150848:12345-192.168.201.9@tcp:58:bash.0 00010000:00010000:2.0:1787779795.030083:0:16187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d3e00/0x9e63ba8af688a5da lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779795.030095:0:16187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d3e00/0x9e63ba8af688a5da lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779795.030104:0:16187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d3e00/0x9e63ba8af688a5da lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787779795.030691:0:16187:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787779795.031169:0:16187:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1787779795.031219:0:16187:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1787779795.031307:0:16187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87a70a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:43b382b8-5aec-409a-8dc5-84d259a200e7+24:14553:x1874622505150848:12345-192.168.201.9@tcp:58:bash.0 Request processed in 1318us (1607us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779795.031315:0:16187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 44 00000100:00100000:1.0:1787779795.033012:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779795.033055:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505150976 00000100:00100000:3.0:1787779795.033064:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505150976 00000100:00100000:3.0:1787779795.033112:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 45 00000100:00100000:3.0:1787779795.033122:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ece43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:43b382b8-5aec-409a-8dc5-84d259a200e7+24:14553:x1874622505150976:12345-192.168.201.9@tcp:101:bash.0 00010000:00010000:3.0:1787779795.033143:0:14309:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779795.033163:0:14309:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af688a5e1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedb16c expref: -99 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779795.033210:0:14309:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d3e00/0x9e63ba8af688a5da lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779795.033218:0:14309:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af688a5e1 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb16c expref: 25 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779795.033232:0:14309:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d3e00/0x9e63ba8af688a5da lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779795.033241:0:14309:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af688a5e1 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb16c expref: 25 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779795.033250:0:14309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98e846377800) 00010000:00010000:3.0:1787779795.033253:0:14309:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787779795.033255:0:14309:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af688a5e1 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb16c expref: 25 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779795.033260:0:14309:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87a98b600, rc 0) 00000100:00100000:3.0:1787779795.033327:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ece43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:43b382b8-5aec-409a-8dc5-84d259a200e7+25:14553:x1874622505150976:12345-192.168.201.9@tcp:101:bash.0 Request processed in 206us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779795.033334:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 45 00010000:00010000:1.0:1787779795.442948:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787779795.698974:0:14343:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787779795.698983:0:14343:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787779795.699020:0:14343:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1787779795.699026:0:14343:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1787779795.699167:0:14343:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e74353c3c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14343:1874622525062144:192.168.201.9@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787779795.699622:0:14343:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e86d5a8c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787779795.715990:0:14343:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e74353c3c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14343:1874622525062144:192.168.201.9@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787779795.724873:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779795.736534:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505151104 00000100:00100000:0.0:1787779795.736548:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505151104 00000100:00100000:0.0:1787779795.736613:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 0 00000100:00100000:0.0:1787779795.736624:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ece6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:43b382b8-5aec-409a-8dc5-84d259a200e7+25:14554:x1874622505151104:12345-192.168.201.9@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1787779795.736754:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ece6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:43b382b8-5aec-409a-8dc5-84d259a200e7+25:14554:x1874622505151104:12345-192.168.201.9@tcp:900:lhsmtool_posix.0 Request processed in 132us (11893us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779795.736763:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 0 00000100:00100000:1.0:1787779795.739778:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779795.740469:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505151232 00000100:00100000:0.0:1787779795.740480:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505151232 00000100:00100000:0.0:1787779795.740548:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 46 00000100:00100000:0.0:1787779795.740558:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ece6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:43b382b8-5aec-409a-8dc5-84d259a200e7+25:14554:x1874622505151232:12345-192.168.201.9@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787779795.740594:0:14310:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787779795.740704:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ece6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:43b382b8-5aec-409a-8dc5-84d259a200e7+25:14554:x1874622505151232:12345-192.168.201.9@tcp:53:lhsmtool_posix.0 Request processed in 147us (935us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779795.740738:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 46 00000100:00100000:3.0:1787779795.747582:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779795.752147:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505151360 00000100:00100000:1.0:1787779795.752179:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505151360 00000100:00100000:1.0:1787779795.752376:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 47 00000100:00100000:1.0:1787779795.752389:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e74353c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:43b382b8-5aec-409a-8dc5-84d259a200e7+25:14554:x1874622505151360:12345-192.168.201.9@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787779795.752476:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94f600/0x9e63ba8af688a5e8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779795.752505:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94f600/0x9e63ba8af688a5e8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779795.752518:0:14311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94f600/0x9e63ba8af688a5e8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779795.752574:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94f800/0x9e63ba8af688a5ef lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779795.752583:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94f800/0x9e63ba8af688a5ef lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779795.752590:0:14311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94f800/0x9e63ba8af688a5ef lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779795.752613:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94e600/0x9e63ba8af688a5f6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779795.752621:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94e600/0x9e63ba8af688a5f6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779795.752640:0:14311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94e600/0x9e63ba8af688a5f6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787779795.752679:0:14311:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1787779795.752684:0:14311:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787779795.752706:0:14311:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94e600/0x9e63ba8af688a5f6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779795.752738:0:14311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94f600/0x9e63ba8af688a5e8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779795.752745:0:14311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94f600/0x9e63ba8af688a5e8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779795.752752:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94f600/0x9e63ba8af688a5e8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779795.752758:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87a94f600 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:1.0:1787779795.752764:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94f600/0x9e63ba8af688a5e8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779795.752772:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94f600/0x9e63ba8af688a5e8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779795.752795:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98e87450a000) 00010000:00010000:1.0:1787779795.752799:0:14311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787779795.752804:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94f600/0x9e63ba8af688a5e8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779795.752810:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94f600/0x9e63ba8af688a5e8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779795.752825:0:14311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94f800/0x9e63ba8af688a5ef lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779795.752831:0:14311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94f800/0x9e63ba8af688a5ef lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779795.752837:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94f800/0x9e63ba8af688a5ef lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779795.752848:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87a94f800 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:1.0:1787779795.752852:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94f800/0x9e63ba8af688a5ef lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779795.752858:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94f800/0x9e63ba8af688a5ef lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779795.752868:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff98e860e7ea00) 00010000:00010000:1.0:1787779795.752870:0:14311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787779795.752873:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94f800/0x9e63ba8af688a5ef lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779795.752910:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94f800/0x9e63ba8af688a5ef lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779795.752925:0:14311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94e600/0x9e63ba8af688a5f6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779795.752932:0:14311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94e600/0x9e63ba8af688a5f6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779795.752937:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94e600/0x9e63ba8af688a5f6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779795.752942:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87a94e600 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:1.0:1787779795.752945:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94e600/0x9e63ba8af688a5f6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779795.752951:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94e600/0x9e63ba8af688a5f6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779795.752984:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98e846377800) 00010000:00010000:1.0:1787779795.752987:0:14311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787779795.752990:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94e600/0x9e63ba8af688a5f6 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779795.752996:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94e600/0x9e63ba8af688a5f6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779795.753090:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e74353c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:43b382b8-5aec-409a-8dc5-84d259a200e7+25:14554:x1874622505151360:12345-192.168.201.9@tcp:34:lhsmtool_posix.0 Request processed in 702us (5516us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779795.753099:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 47 00000100:00100000:1.0:1787779795.755915:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779795.756016:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505151616 00000100:00100000:0.0:1787779795.756025:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505151616 00000100:00100000:0.0:1787779795.756088:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 48 00000100:00100000:0.0:1787779795.756098:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ece4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:43b382b8-5aec-409a-8dc5-84d259a200e7+25:14554:x1874622505151616:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787779795.756116:0:14310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787779795.756136:0:14310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af688a5fd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedb173 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779795.756235:0:14310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af688a604 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779795.756267:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af688a604 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779795.756289:0:14310:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af688a604 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787779795.756301:0:14310:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787779795.756399:0:14310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af688a604 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779795.756406:0:14310:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af688a604 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779795.756413:0:14310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af688a604 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779795.756419:0:14310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e848f69800 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:0.0:1787779795.756422:0:14310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af688a604 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779795.756430:0:14310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af688a604 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779795.756442:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98e846377800) 00010000:00010000:0.0:1787779795.756445:0:14310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787779795.756449:0:14310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af688a604 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779795.756454:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af688a604 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779795.756493:0:14310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af688a5fd lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb173 expref: 27 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779795.756509:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98e87450a000) 00010000:00010000:0.0:1787779795.756511:0:14310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787779795.756515:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af688a5fd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb173 expref: 27 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779795.756525:0:14310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e848f69600, rc 0) 00000100:00100000:0.0:1787779795.756586:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ece4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:43b382b8-5aec-409a-8dc5-84d259a200e7+26:14554:x1874622505151616:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 Request processed in 491us (680us total) trans 8589934619 rc 301/301 00000100:00100000:0.0:1787779795.756593:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 48 00000100:00100000:0.0:1787779795.760137:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779795.760361:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505151744 00000100:00100000:3.0:1787779795.760371:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505151744 00000100:00100000:3.0:1787779795.760478:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 49 00000100:00100000:3.0:1787779795.760488:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e852b9cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:43b382b8-5aec-409a-8dc5-84d259a200e7+26:14554:x1874622505151744:12345-192.168.201.9@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787779795.760533:0:14309:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787779795.760644:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e852b9cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:43b382b8-5aec-409a-8dc5-84d259a200e7+26:14554:x1874622505151744:12345-192.168.201.9@tcp:53:lhsmtool_posix.0 Request processed in 157us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779795.760652:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 49 00000100:00100000:0.0:1787779795.766628:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779795.768959:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505152000 00000100:00100000:1.0:1787779795.768978:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505152000 00000100:00100000:1.0:1787779795.769107:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 50 00000100:00100000:1.0:1787779795.769118:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e852b9cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:43b382b8-5aec-409a-8dc5-84d259a200e7+26:14554:x1874622505152000:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787779795.769139:0:14310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779795.769162:0:14310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94e600/0x9e63ba8af688a612 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedb17a expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787779795.770265:0:14310:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x6:0x0], count =28 00000004:00080000:1.0:1787779795.770274:0:14310:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x6:0x0]+28 in llog 00000004:00080000:1.0:1787779795.770321:0:14310:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:1.0:1787779795.770599:0:14310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94f800/0x9e63ba8af688a619 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779795.770616:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94f800/0x9e63ba8af688a619 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779795.770639:0:14310:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94f800/0x9e63ba8af688a619 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779795.770700:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94e600/0x9e63ba8af688a612 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb17a expref: 29 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779795.770785:0:14310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94f800/0x9e63ba8af688a619 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb17a expref: 28 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779795.770795:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98e860e7ea00) 00010000:00010000:1.0:1787779795.770798:0:14310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787779795.770801:0:14310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87a94f800, rc 0) 00000100:00100000:0.0:1787779795.775281:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e852b9cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:43b382b8-5aec-409a-8dc5-84d259a200e7+28:14554:x1874622505152000:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 Request processed in 6144us (8642us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1787779795.775297:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 50 00000100:00100000:0.0:1787779795.780298:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779795.780620:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505152256 00000100:00100000:2.0:1787779795.780629:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505152256 00000100:00100000:2.0:1787779795.780687:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 51 00000100:00100000:2.0:1787779795.780696:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ab18b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:43b382b8-5aec-409a-8dc5-84d259a200e7+28:14554:x1874622505152256:12345-192.168.201.9@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787779795.780780:0:14311:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787779795.780816:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94f800/0x9e63ba8af688a619 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb17a expref: 28 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779795.780842:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98e860e7ea00) 00010000:00010000:2.0:1787779795.780852:0:14311:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787779795.780884:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d2000/0x9e63ba8af688a627 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779795.780899:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d2000/0x9e63ba8af688a627 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779795.780908:0:14311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d2000/0x9e63ba8af688a627 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779795.780988:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d2c00/0x9e63ba8af688a62e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x4fd1568f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779795.780996:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d2c00/0x9e63ba8af688a62e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4fd1568f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779795.781003:0:14311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d2c00/0x9e63ba8af688a62e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4fd1568f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779795.781298:0:14311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d2000/0x9e63ba8af688a627 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779795.781317:0:14311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d2000/0x9e63ba8af688a627 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779795.781324:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d2000/0x9e63ba8af688a627 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779795.781330:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e7430d2000 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:2.0:1787779795.781334:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d2000/0x9e63ba8af688a627 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779795.781342:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d2000/0x9e63ba8af688a627 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779795.781352:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98e87450a400) 00010000:00010000:2.0:1787779795.781354:0:14311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787779795.781359:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d2000/0x9e63ba8af688a627 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779795.781365:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d2000/0x9e63ba8af688a627 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779795.781374:0:14311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d2c00/0x9e63ba8af688a62e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4fd1568f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779795.781380:0:14311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d2c00/0x9e63ba8af688a62e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4fd1568f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779795.781385:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d2c00/0x9e63ba8af688a62e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4fd1568f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779795.781390:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e7430d2c00 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:2.0:1787779795.781399:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d2c00/0x9e63ba8af688a62e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4fd1568f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779795.781406:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d2c00/0x9e63ba8af688a62e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4fd1568f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779795.781414:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x4fd1568f (ffff98e846377700) 00010000:00010000:2.0:1787779795.781417:0:14311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787779795.781420:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d2c00/0x9e63ba8af688a62e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x4fd1568f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779795.781425:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d2c00/0x9e63ba8af688a62e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x4fd1568f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779795.782211:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ab18b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:43b382b8-5aec-409a-8dc5-84d259a200e7+27:14554:x1874622505152256:12345-192.168.201.9@tcp:36:lhsmtool_posix.0 Request processed in 1511us (1919us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787779795.782222:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 51 00000100:00100000:2.0:1787779795.792480:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779795.792672:0:16187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505152384 00000100:00100000:3.0:1787779795.792682:0:16187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505152384 00000100:00100000:3.0:1787779795.792981:0:16187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 52 00000100:00100000:3.0:1787779795.792994:0:16187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e741e6f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:43b382b8-5aec-409a-8dc5-84d259a200e7+27:14554:x1874622505152384:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787779795.793018:0:16187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779795.793041:0:16187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af688a635 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedb181 expref: -99 pid: 16187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779795.793104:0:16187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b800/0x9e63ba8af688a63c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779795.793119:0:16187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b800/0x9e63ba8af688a63c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779795.793131:0:16187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b800/0x9e63ba8af688a63c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779795.793232:0:16187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af688a635 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb181 expref: 29 pid: 16187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779795.793251:0:16187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b800/0x9e63ba8af688a63c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb181 expref: 28 pid: 16187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779795.793261:0:16187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98e87450a500) 00010000:00010000:3.0:1787779795.793264:0:16187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787779795.793267:0:16187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87a98b800, rc 0) 00000100:00100000:3.0:1787779795.793377:0:16187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e741e6f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:43b382b8-5aec-409a-8dc5-84d259a200e7+28:14554:x1874622505152384:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 Request processed in 386us (908us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779795.793386:0:16187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 52 00000100:00100000:1.0:1787779795.803146:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779795.803323:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505152640 00000100:00100000:3.0:1787779795.803335:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505152640 00000100:00100000:3.0:1787779795.803397:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 53 00000100:00100000:3.0:1787779795.803408:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ece7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:43b382b8-5aec-409a-8dc5-84d259a200e7+28:14554:x1874622505152640:12345-192.168.201.9@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787779795.803508:0:14309:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af688a643 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779795.803545:0:14309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af688a643 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779795.803558:0:14309:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af688a643 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787779795.804024:0:14309:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:3.0:1787779795.804034:0:14309:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 561545321548ns, next at 562545319501ns, rc = 0 00000004:00010000:3.0:1787779795.804119:0:14309:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003df894f4 reply state 00000000d35cbae4 transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af688a643 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779795.804128:0:14309:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787779795.804240:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ece7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:43b382b8-5aec-409a-8dc5-84d259a200e7+30:14554:x1874622505152640:12345-192.168.201.9@tcp:36:lhsmtool_posix.0 Request processed in 833us (1104us total) trans 8589934621 rc 0/0 00000100:00100000:3.0:1787779795.804249:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 53 00000100:00100000:1.0:1787779795.810169:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779795.810443:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505152768 00000100:00100000:0.0:1787779795.810454:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505152768 00000100:00100000:0.0:1787779795.810533:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 54 00000100:00100000:0.0:1787779795.810543:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ece5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:43b382b8-5aec-409a-8dc5-84d259a200e7+30:14554:x1874622505152768:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787779795.810571:0:14310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787779795.810592:0:14310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69e00/0x9e63ba8af688a64a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedb188 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779795.810656:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69e00/0x9e63ba8af688a64a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb188 expref: 31 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779795.810694:0:14310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69e00/0x9e63ba8af688a64a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb188 expref: 31 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779795.810760:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98e87450a500) 00010000:00010000:0.0:1787779795.810764:0:14310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787779795.810767:0:14310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e848f69e00, rc 0) 00000100:00100000:0.0:1787779795.811022:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ece5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:43b382b8-5aec-409a-8dc5-84d259a200e7+31:14554:x1874622505152768:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 Request processed in 479us (865us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779795.811031:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 54 00010000:00010000:2.0:1787779795.813158:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af688a643 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779795.813174:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af688a643 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779795.813181:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af688a643 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779795.813189:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87a98ae00 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:2.0:1787779795.813194:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af688a643 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779795.813202:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af688a643 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779795.813230:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98e87450a500) 00010000:00010000:2.0:1787779795.813232:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787779795.813237:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af688a643 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779795.813243:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98ae00/0x9e63ba8af688a643 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779795.813749:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779795.813796:0:16506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505152896 00000100:00100000:2.0:1787779795.813808:0:16506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505152896 00000100:00100000:2.0:1787779795.813980:0:16506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 12 00000100:00100000:2.0:1787779795.813991:0:16506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ab18780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:43b382b8-5aec-409a-8dc5-84d259a200e7+5:2359:x1874622505152896:12345-192.168.201.9@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787779795.814334:0:16506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ab18780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:43b382b8-5aec-409a-8dc5-84d259a200e7+6:2359:x1874622505152896:12345-192.168.201.9@tcp:2:lhsmtool_posix.0 Request processed in 344us (587us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1787779795.814342:0:16506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 12 00000100:00080000:1.0:1787779795.814463:0:14305:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787779795.816638:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779795.816709:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505153152 00000100:00100000:2.0:1787779795.816741:0:14312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505153152 00000100:00100000:2.0:1787779795.816796:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 11 00000100:00100000:2.0:1787779795.816806:0:14312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ece5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:43b382b8-5aec-409a-8dc5-84d259a200e7+30:14554:x1874622505153152:12345-192.168.201.9@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787779795.817120:0:14312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ece5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:43b382b8-5aec-409a-8dc5-84d259a200e7+31:14554:x1874622505153152:12345-192.168.201.9@tcp:35:lhsmtool_posix.0 Request processed in 316us (490us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1787779795.817126:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 11 00000100:00100000:0.0:1787779795.819338:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779795.819422:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505153408 00000100:00100000:3.0:1787779795.819430:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505153408 00000100:00100000:3.0:1787779795.819481:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 55 00000100:00100000:3.0:1787779795.819490:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ab1ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:43b382b8-5aec-409a-8dc5-84d259a200e7+31:14554:x1874622505153408:12345-192.168.201.9@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787779795.819595:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ab1ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:43b382b8-5aec-409a-8dc5-84d259a200e7+31:14554:x1874622505153408:12345-192.168.201.9@tcp:57:lhsmtool_posix.0 Request processed in 105us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779795.819602:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 55 00000100:00100000:0.0:1787779795.822210:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779795.822367:0:16187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505153536 00000100:00100000:3.0:1787779795.822378:0:16187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505153536 00000100:00100000:3.0:1787779795.822480:0:16187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 56 00000100:00100000:3.0:1787779795.822490:0:16187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ab19e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:43b382b8-5aec-409a-8dc5-84d259a200e7+31:14554:x1874622505153536:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787779795.822522:0:16187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779795.822558:0:16187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af688a651 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedb18f expref: -99 pid: 16187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779795.822620:0:16187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af688a658 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779795.822631:0:16187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af688a658 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779795.822639:0:16187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af688a658 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787779795.822669:0:16187:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787779795.822682:0:16187:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af688a658 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779795.822702:0:16187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a400/0x9e63ba8af688a651 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb18f expref: 33 pid: 16187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779795.822740:0:16187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af688a658 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb18f expref: 32 pid: 16187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779795.822749:0:16187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98e87450a500) 00010000:00010000:3.0:1787779795.822752:0:16187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787779795.822757:0:16187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87a98a600, rc 0) 00000100:00100000:2.0:1787779795.822899:0:16187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ab19e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:43b382b8-5aec-409a-8dc5-84d259a200e7+32:14554:x1874622505153536:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 Request processed in 409us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779795.822907:0:16187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 56 00000100:00100000:2.0:1787779795.826551:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779795.826627:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505153664 00000100:00100000:1.0:1787779795.826636:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505153664 00000100:00100000:1.0:1787779795.826687:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 13 00000100:00100000:1.0:1787779795.826698:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e741e6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:43b382b8-5aec-409a-8dc5-84d259a200e7+6:2360:x1874622505153664:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787779795.826744:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779795.826768:0:14991:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3688a86/0x9e63ba8af688a65f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedb196 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787779795.826798:0:14991:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8f5ad3, blocks: 0x1 00010000:00010000:1.0:1787779795.826817:0:14991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=561s v=(0 0) 00010000:00010000:1.0:1787779795.826822:0:14991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787779795.826839:0:14991:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3688a86/0x9e63ba8af688a65f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb196 expref: 7 pid: 14991 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779795.826861:0:14991:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b3688a86/0x9e63ba8af688a65f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb196 expref: 7 pid: 14991 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779795.826889:0:14991:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87a94e200, rc 0) 00000100:00100000:1.0:1787779795.826942:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e741e6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:43b382b8-5aec-409a-8dc5-84d259a200e7+7:2360:x1874622505153664:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 Request processed in 246us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779795.826949:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 13 00000100:00100000:0.0:1787779795.828642:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779795.828781:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505153920 00000100:00100000:3.0:1787779795.828788:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505153920 00000100:00100000:2.0:1787779795.829253:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 57 00000100:00100000:2.0:1787779795.829265:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ab1bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:43b382b8-5aec-409a-8dc5-84d259a200e7+32:14554:x1874622505153920:12345-192.168.201.9@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787779795.829390:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ab1bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:43b382b8-5aec-409a-8dc5-84d259a200e7+32:14554:x1874622505153920:12345-192.168.201.9@tcp:57:lhsmtool_posix.0 Request processed in 127us (757us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779795.829398:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 57 00000100:00100000:2.0:1787779795.832221:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779795.832407:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505154048 00000100:00100000:1.0:1787779795.832418:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505154048 00000100:00100000:1.0:1787779795.832505:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 58 00000100:00100000:1.0:1787779795.832512:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e741e6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:43b382b8-5aec-409a-8dc5-84d259a200e7+32:14554:x1874622505154048:12345-192.168.201.9@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1787779795.876616:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934619 is committed 00000001:00080000:3.0:1787779795.876753:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934620 is committed 00000001:00080000:3.0:1787779795.876768:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000004:00080000:3.0:1787779795.876780:0:5857:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:0.0:1787779795.877079:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e741e6d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622525062272:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787779795.877150:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779795.877267:0:14994:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525062272 00000100:00100000:2.0:1787779795.877286:0:14994:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525062272 00000100:00100000:2.0:1787779795.877348:0:14994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787779795.877358:0:14994:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ab183c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622525062272:12345-0@lo:2:osp-syn-1-0.0 00000100:00080000:0.0:1787779795.877610:0:14305:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:2.0:1787779795.879411:0:14994:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1787779795.879418:0:14994:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1787779795.879421:0:14994:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787779795.879423:0:14994:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787779795 -> 1787779795 00002000:00010000:2.0:1787779795.879426:0:14994:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787779795.879700:0:14994:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ab183c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1874622525062272:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2338us (2545us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1787779795.879725:0:14994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:0.0:1787779795.879859:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98e741e6d680/2, rc 0, transno 8589934595 00000100:00100000:0.0:1787779795.879866:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e741e6d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622525062272:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787779795.880219:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e741e6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:43b382b8-5aec-409a-8dc5-84d259a200e7+13:14554:x1874622505154048:12345-192.168.201.9@tcp:44:lhsmtool_posix.0 Request processed in 47704us (48007us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779795.880228:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 58 00000100:00100000:0.0:1787779795.889268:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779795.889412:0:14993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505154176 00000100:00100000:1.0:1787779795.889422:0:14993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505154176 00000100:00100000:1.0:1787779795.889480:0:14993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 15 00000100:00100000:1.0:1787779795.889499:0:14993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ab1a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:43b382b8-5aec-409a-8dc5-84d259a200e7+7:2359:x1874622505154176:12345-192.168.201.9@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1787779795.889610:0:14993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ab1a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:43b382b8-5aec-409a-8dc5-84d259a200e7+7:2359:x1874622505154176:12345-192.168.201.9@tcp:16:lhsmtool_posix.0 Request processed in 122us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779795.889618:0:14993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 15 00000100:00100000:0.0:1787779795.895425:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779795.895530:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505154432 00000100:00100000:2.0:1787779795.895541:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505154432 00000100:00100000:2.0:1787779795.895600:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 59 00000100:00100000:2.0:1787779795.895609:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ab18f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:43b382b8-5aec-409a-8dc5-84d259a200e7+13:14554:x1874622505154432:12345-192.168.201.9@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787779795.895659:0:14309:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787779795.895686:0:14309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98a600/0x9e63ba8af688a658 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb18f expref: 13 pid: 16187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779795.895750:0:14309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98e87450a500) 00010000:00010000:2.0:1787779795.895755:0:14309:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787779795.895790:0:14309:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d2c00/0x9e63ba8af688a666 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779795.895804:0:14309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d2c00/0x9e63ba8af688a666 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779795.895814:0:14309:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d2c00/0x9e63ba8af688a666 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787779795.896043:0:14309:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002e28032b reply state 00000000f20b7211 transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d2c00/0x9e63ba8af688a666 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779795.896052:0:14309:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787779795.896148:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ab18f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:43b382b8-5aec-409a-8dc5-84d259a200e7+14:14554:x1874622505154432:12345-192.168.201.9@tcp:36:lhsmtool_posix.0 Request processed in 540us (733us total) trans 8589934623 rc 0/0 00000100:00100000:2.0:1787779795.896156:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 59 00010000:00010000:0.0:1787779795.900340:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d2c00/0x9e63ba8af688a666 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779795.900359:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d2c00/0x9e63ba8af688a666 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779795.900386:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d2c00/0x9e63ba8af688a666 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779795.900393:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e7430d2c00 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:0.0:1787779795.900398:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d2c00/0x9e63ba8af688a666 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779795.900406:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d2c00/0x9e63ba8af688a666 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779795.900423:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98e87450a500) 00010000:00010000:0.0:1787779795.900426:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787779795.900431:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d2c00/0x9e63ba8af688a666 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779795.900438:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d2c00/0x9e63ba8af688a666 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779795.905159:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779795.905251:0:14994:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505154560 00000100:00100000:1.0:1787779795.905274:0:14994:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505154560 00000100:00100000:1.0:1787779795.905337:0:14994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 16 00000100:00100000:1.0:1787779795.905346:0:14994:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ab1a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:43b382b8-5aec-409a-8dc5-84d259a200e7+7:14554:x1874622505154560:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787779795.905365:0:14994:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779795.905383:0:14994:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b8a72abe/0x9e63ba8af688a66d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedb19d expref: -99 pid: 14994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779795.905415:0:14994:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b3688a86/0x9e63ba8af688a65f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb196 expref: 8 pid: 14991 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779795.905423:0:14994:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787779795.905428:0:14994:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787779795.905433:0:14994:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b8a72abe/0x9e63ba8af688a66d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb19d expref: 8 pid: 14994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779795.905462:0:14994:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b3688a86/0x9e63ba8af688a65f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb196 expref: 8 pid: 14991 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779795.905474:0:14994:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b3688a86/0x9e63ba8af688a65f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb196 expref: 8 pid: 14991 timeout: 661 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779795.905488:0:14994:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ece52c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:14994:1874622525062400:192.168.201.9@tcp:104: 00000100:00100000:1.0:1787779795.905587:0:14994:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e849115780 going to sleep for 11 seconds 00000100:00100000:0.0:1787779795.914097:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779795.914178:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505154688 00000100:00100000:3.0:1787779795.914188:0:14294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505154688 00010000:00010000:3.0:1787779795.914232:0:14294:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b3688a86/0x9e63ba8af688a65f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb196 expref: 9 pid: 14991 timeout: 661 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779795.914275:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 14 00000100:00100000:3.0:1787779795.914285:0:14294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ab192c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:43b382b8-5aec-409a-8dc5-84d259a200e7+9:2359:x1874622505154688:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787779795.914302:0:14294:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787779795.914329:0:14294:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b3688a86/0x9e63ba8af688a65f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb196 expref: 9 pid: 14991 timeout: 661 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779795.914344:0:14294:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b3688a86/0x9e63ba8af688a65f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb196 expref: 9 pid: 14991 timeout: 661 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779795.914373:0:14294:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787779795.914377:0:14294:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787779795.914384:0:14294:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b8a72abe/0x9e63ba8af688a66d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb19d expref: 9 pid: 14994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779795.914395:0:14294:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b8a72abe/0x9e63ba8af688a66d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb19d expref: 9 pid: 14994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779795.914436:0:14294:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b8a72abe/0x9e63ba8af688a66d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb19d expref: 9 pid: 14994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779795.914451:0:14294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e74353cf00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:14294:1874622525062528:192.168.201.9@tcp:105: 00000100:00100000:3.0:1787779795.914570:0:14294:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e845f4e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787779795.917262:0:14294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e74353cf00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:14294:1874622525062528:192.168.201.9@tcp:105: 00010000:00010000:3.0:1787779795.917292:0:14294:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787779795.917355:0:14294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ab192c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:43b382b8-5aec-409a-8dc5-84d259a200e7+9:2359:x1874622505154688:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 3071us (3268us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779795.917366:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 14 00010000:00010000:1.0:1787779795.919016:0:14994:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3688a86/0x9e63ba8af688a65f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb196 expref: 8 pid: 14991 timeout: 661 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779795.919063:0:14994:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ece52c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:14994:1874622525062400:192.168.201.9@tcp:104: 00010000:00010000:1.0:1787779795.919094:0:14994:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b8a72abe/0x9e63ba8af688a66d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb19d expref: 7 pid: 14994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779795.919109:0:14994:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87a94ee00, rc 0) 00000100:00100000:1.0:1787779795.919163:0:14994:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ab1a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:43b382b8-5aec-409a-8dc5-84d259a200e7+7:14554:x1874622505154560:12345-192.168.201.9@tcp:101:lhsmtool_posix.0 Request processed in 13818us (14015us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779795.919599:0:14994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 16 00000100:00100000:2.0:1787779795.921238:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779795.921452:0:14993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505154816 00000100:00100000:1.0:1787779795.921464:0:14993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505154816 00000100:00100000:1.0:1787779795.921993:0:14993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 17 00000100:00100000:1.0:1787779795.922007:0:14993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e741e6cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:43b382b8-5aec-409a-8dc5-84d259a200e7+7:2360:x1874622505154816:12345-192.168.201.9@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787779795.922214:0:14993:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787779795.922218:0:14993:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1787779794 00002000:00010000:1.0:1787779795.922220:0:14993:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1787779793 00002000:00010000:1.0:1787779795.922222:0:14993:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787779795 -> 1787779794 00002000:00010000:1.0:1787779795.922224:0:14993:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787779795.922283:0:14993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e741e6cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:43b382b8-5aec-409a-8dc5-84d259a200e7+8:2360:x1874622505154816:12345-192.168.201.9@tcp:2:lhsmtool_posix.0 Request processed in 280us (1050us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1787779795.922291:0:14993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 17 00000100:00100000:2.0:1787779795.925207:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779795.925316:0:16506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505154944 00000100:00100000:3.0:1787779795.925327:0:16506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505154944 00000100:00100000:3.0:1787779795.925383:0:16506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 18 00000100:00100000:3.0:1787779795.925394:0:16506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec9c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:43b382b8-5aec-409a-8dc5-84d259a200e7+8:2357:x1874622505154944:12345-192.168.201.9@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787779795.925439:0:16506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000807640ef/0x9e63ba8af688a674 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779795.925460:0:16506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b8a72abe/0x9e63ba8af688a66d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb19d expref: 8 pid: 14994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779795.925469:0:16506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787779795.925474:0:16506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787779795.925480:0:16506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000807640ef/0x9e63ba8af688a674 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779795.925517:0:16506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b8a72abe/0x9e63ba8af688a66d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb19d expref: 8 pid: 14994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779795.925531:0:16506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b8a72abe/0x9e63ba8af688a66d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb19d expref: 8 pid: 14994 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779795.925566:0:16506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e74353cf00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:16506:1874622525062656:192.168.201.9@tcp:104: 00000100:00100000:3.0:1787779795.925677:0:16506:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e845f4e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787779795.929765:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779795.929865:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505155072 00000100:00100000:2.0:1787779795.929883:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505155072 00010000:00010000:2.0:1787779795.929926:0:14295:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b8a72abe/0x9e63ba8af688a66d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb19d expref: 9 pid: 14994 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779795.929970:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 15 00000100:00100000:2.0:1787779795.929980:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ab19a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:43b382b8-5aec-409a-8dc5-84d259a200e7+9:2360:x1874622505155072:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787779795.930012:0:14295:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787779795.930039:0:14295:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b8a72abe/0x9e63ba8af688a66d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb19d expref: 9 pid: 14994 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779795.930053:0:14295:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b8a72abe/0x9e63ba8af688a66d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb19d expref: 9 pid: 14994 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779795.930080:0:14295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787779795.930085:0:14295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787779795.930090:0:14295:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000807640ef/0x9e63ba8af688a674 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 16506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779795.930101:0:14295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000807640ef/0x9e63ba8af688a674 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 16506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779795.930121:0:14295:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787779795.930183:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ab19a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:43b382b8-5aec-409a-8dc5-84d259a200e7+9:2360:x1874622505155072:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 204us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779795.930192:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 15 00010000:00010000:3.0:1787779795.931357:0:16506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b8a72abe/0x9e63ba8af688a66d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb19d expref: 8 pid: 14994 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779795.931377:0:16506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e74353cf00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:16506:1874622525062656:192.168.201.9@tcp:104: 00010000:00010000:3.0:1787779795.931401:0:16506:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000807640ef/0x9e63ba8af688a674 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779795.931414:0:16506:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000807640ef/0x9e63ba8af688a674 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779795.931421:0:16506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000807640ef/0x9e63ba8af688a674 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779795.931449:0:16506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000807640ef/0x9e63ba8af688a674 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779795.931458:0:16506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000807640ef/0x9e63ba8af688a674 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779795.931466:0:16506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000807640ef/0x9e63ba8af688a674 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779795.931550:0:16506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e87a98a400 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:3.0:1787779795.931556:0:16506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000807640ef/0x9e63ba8af688a674 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779795.931565:0:16506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000807640ef/0x9e63ba8af688a674 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779795.931580:0:16506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000807640ef/0x9e63ba8af688a674 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779795.931588:0:16506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000807640ef/0x9e63ba8af688a674 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779795.931706:0:16506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec9c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:43b382b8-5aec-409a-8dc5-84d259a200e7+7:2357:x1874622505154944:12345-192.168.201.9@tcp:1:lhsmtool_posix.0 Request processed in 6314us (6509us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779795.931756:0:16506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 18 00000100:00100000:0.0:1787779795.934120:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779795.934235:0:16187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505155328 00000100:00100000:2.0:1787779795.934245:0:16187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505155328 00000100:00100000:2.0:1787779795.934351:0:16187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 60 00000100:00100000:2.0:1787779795.934361:0:16187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ab1a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:43b382b8-5aec-409a-8dc5-84d259a200e7+13:14554:x1874622505155328:12345-192.168.201.9@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787779795.934440:0:16187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d3a00/0x9e63ba8af688a67b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779795.934458:0:16187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d3a00/0x9e63ba8af688a67b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779795.934484:0:16187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d3a00/0x9e63ba8af688a67b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779795.938343:0:16187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d3400/0x9e63ba8af688a682 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779795.938375:0:16187:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69e00/0x9e63ba8af688a64a lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb188 expref: 14 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779795.938385:0:16187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d3400/0x9e63ba8af688a682 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779795.938434:0:16187:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69e00/0x9e63ba8af688a64a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb188 expref: 14 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779795.938452:0:16187:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69e00/0x9e63ba8af688a64a lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb188 expref: 14 pid: 14310 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779795.938467:0:16187:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ec9cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16187:1874622525062784:192.168.201.9@tcp:104: 00000100:00100000:2.0:1787779795.938583:0:16187:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e846ae8780 going to sleep for 11 seconds 00000100:00100000:0.0:1787779795.942436:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779795.942763:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505155456 00000100:00100000:3.0:1787779795.942773:0:14294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505155456 00010000:00010000:3.0:1787779795.942924:0:14294:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69e00/0x9e63ba8af688a64a lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb188 expref: 15 pid: 14310 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779795.942972:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 16 00000100:00100000:3.0:1787779795.942983:0:14294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ab19680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:43b382b8-5aec-409a-8dc5-84d259a200e7+15:2359:x1874622505155456:12345-192.168.201.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787779795.943001:0:14294:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787779795.943021:0:14294:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69e00/0x9e63ba8af688a64a lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb188 expref: 15 pid: 14310 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779795.943034:0:14294:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69e00/0x9e63ba8af688a64a lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb188 expref: 15 pid: 14310 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779795.943054:0:14294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98e87450a500) 00010000:00010000:3.0:1787779795.943059:0:14294:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d3400/0x9e63ba8af688a682 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779795.943068:0:14294:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d3400/0x9e63ba8af688a682 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779795.943074:0:14294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d3400/0x9e63ba8af688a682 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779795.943091:0:14294:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787779795.943133:0:14294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ab19680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:43b382b8-5aec-409a-8dc5-84d259a200e7+15:2359:x1874622505155456:12345-192.168.201.9@tcp:103:ldlm_bl.0 Request processed in 154us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779795.943141:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 16 00010000:00010000:2.0:1787779795.943883:0:16187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69e00/0x9e63ba8af688a64a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb188 expref: 14 pid: 14310 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779795.943903:0:16187:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ec9cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16187:1874622525062784:192.168.201.9@tcp:104: 00010000:00010000:2.0:1787779795.943923:0:16187:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d3400/0x9e63ba8af688a682 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779795.943933:0:16187:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d3400/0x9e63ba8af688a682 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779795.943948:0:16187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d3400/0x9e63ba8af688a682 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787779795.944138:0:16187:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:2.0:1787779795.944284:0:16187:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:2.0:1787779795.944331:0:16187:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:2.0:1787779795.944431:0:16187:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ec9cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16187:1874622525062912:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787779795.944545:0:16187:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779795.944583:0:16187:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e846ae8900 going to sleep for 11 seconds 00000100:00100000:3.0:1787779795.944673:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525062912 00000100:00100000:3.0:1787779795.944679:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525062912 00000100:00100000:3.0:1787779795.944761:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787779795.944771:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec9a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16187:x1874622525062912:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787779795.944841:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec9a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16187:x1874622525062912:12345-0@lo:1000:mdt00_003.0 Request processed in 72us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779795.944848:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787779795.945330:0:16187:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ec9cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16187:1874622525062912:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1787779795.946359:0:16187:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:0.0:1787779795.946439:0:16187:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ab1b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16187:1874622525063040:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787779795.946497:0:16187:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779795.946542:0:16187:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e846ae8780 going to sleep for 11 seconds 00000100:00100000:1.0:1787779795.946888:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525063040 00000100:00100000:1.0:1787779795.946897:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525063040 00000100:00100000:1.0:1787779795.946945:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787779795.946954:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ab18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16187:x1874622525063040:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787779795.947131:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ab18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:16187:x1874622525063040:12345-0@lo:1000:mdt00_003.0 Request processed in 178us (633us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1787779795.947138:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787779795.947393:0:16187:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ab1b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16187:1874622525063040:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1787779795.947425:0:16187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d3400/0x9e63ba8af688a682 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779795.947435:0:16187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d3400/0x9e63ba8af688a682 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779795.947443:0:16187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d3400/0x9e63ba8af688a682 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779795.947448:0:16187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e7430d3400 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:0.0:1787779795.947452:0:16187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d3400/0x9e63ba8af688a682 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779795.947459:0:16187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d3400/0x9e63ba8af688a682 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779795.947472:0:16187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98e87450a500) 00010000:00010000:0.0:1787779795.947475:0:16187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787779795.947479:0:16187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d3400/0x9e63ba8af688a682 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779795.947485:0:16187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d3400/0x9e63ba8af688a682 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779795.947527:0:16187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d3e00/0x9e63ba8af688a5da lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779795.947533:0:16187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d3e00/0x9e63ba8af688a5da lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779795.947538:0:16187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d3e00/0x9e63ba8af688a5da lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779795.947550:0:16187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e7430d3e00 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:0.0:1787779795.947553:0:16187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d3e00/0x9e63ba8af688a5da lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779795.947559:0:16187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d3e00/0x9e63ba8af688a5da lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779795.947567:0:16187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98e846377800) 00010000:00010000:0.0:1787779795.947569:0:16187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787779795.947575:0:16187:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af688a5e1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb16c expref: 17 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779795.947586:0:16187:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af688a5e1 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb16c expref: 17 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779795.947595:0:16187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af688a5e1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb16c expref: 17 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779795.947625:0:16187:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a98b600/0x9e63ba8af688a5e1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb16c expref: 17 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779795.947637:0:16187:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87ab1b840 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16187:1874622525063168:192.168.201.9@tcp:105: 00000100:00100000:0.0:1787779795.948470:0:16187:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e846ae8780 going to sleep for 11 seconds 00000100:00100000:2.0:1787779795.954750:0:16187:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87ab1b840 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16187:1874622525063168:192.168.201.9@tcp:105: 00010000:00010000:2.0:1787779795.954799:0:16187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d3e00/0x9e63ba8af688a5da lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779795.954810:0:16187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d3e00/0x9e63ba8af688a5da lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779795.954853:0:16187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d2600/0x9e63ba8af688a689 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779795.954867:0:16187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d2600/0x9e63ba8af688a689 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779795.954890:0:16187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d2600/0x9e63ba8af688a689 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779795.954901:0:16187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d2600/0x9e63ba8af688a689 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779795.954907:0:16187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d2600/0x9e63ba8af688a689 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779795.954931:0:16187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d2600/0x9e63ba8af688a689 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779795.954936:0:16187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e7430d2600 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:2.0:1787779795.954940:0:16187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d2600/0x9e63ba8af688a689 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779795.954947:0:16187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d2600/0x9e63ba8af688a689 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779795.954959:0:16187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98e846377800) 00010000:00010000:2.0:1787779795.954962:0:16187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787779795.954965:0:16187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d2600/0x9e63ba8af688a689 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779795.954971:0:16187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d2600/0x9e63ba8af688a689 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779795.954982:0:16187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d3a00/0x9e63ba8af688a67b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779795.954988:0:16187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d3a00/0x9e63ba8af688a67b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779795.954994:0:16187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d3a00/0x9e63ba8af688a67b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779795.954998:0:16187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e7430d3a00 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:2.0:1787779795.955001:0:16187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d3a00/0x9e63ba8af688a67b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779795.955017:0:16187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d3a00/0x9e63ba8af688a67b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779795.955025:0:16187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98e846377800) 00010000:00010000:2.0:1787779795.955028:0:16187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787779795.955031:0:16187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d3a00/0x9e63ba8af688a67b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779795.955037:0:16187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e7430d3a00/0x9e63ba8af688a67b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16187 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779795.955269:0:16187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ab1a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:43b382b8-5aec-409a-8dc5-84d259a200e7+17:14554:x1874622505155328:12345-192.168.201.9@tcp:57:lhsmtool_posix.0 Request processed in 20907us (21157us total) trans 8589934628 rc 0/0 00000100:00100000:2.0:1787779795.955279:0:16187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 60 00000020:00080000:2.0:1787779795.955286:0:16187:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787779795.956132:0:14343:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787779795.956139:0:14343:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787779795.956178:0:14343:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1787779795.956184:0:14343:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1787779795.957813:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:3.0:1787779795.958219:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505155584 00000100:00100000:3.0:1787779795.958229:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505155584 00000100:00100000:2.0:1787779795.958394:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 12 00000100:00100000:2.0:1787779795.958405:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ece52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:43b382b8-5aec-409a-8dc5-84d259a200e7+17:14553:x1874622505155584:12345-192.168.201.9@tcp:49:bash.0 00000100:00100000:2.0:1787779795.958657:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ece52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:43b382b8-5aec-409a-8dc5-84d259a200e7+17:14553:x1874622505155584:12345-192.168.201.9@tcp:49:bash.0 Request processed in 253us (851us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779795.958666:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 12 00000100:00100000:1.0:1787779795.962257:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779795.962328:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779795.962414:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505155840 00000100:00100000:0.0:1787779795.962424:0:14312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505155840 00000100:00100000:0.0:1787779795.962486:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 13 00000100:00100000:0.0:1787779795.962596:0:14312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ece5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:43b382b8-5aec-409a-8dc5-84d259a200e7+17:14554:x1874622505155840:12345-192.168.201.9@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787779795.963404:0:14312:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787779795.963581:0:14312:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00010000:00010000:0.0:1787779795.963625:0:14312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69000/0x9e63ba8af688a690 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779795.963644:0:14312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69000/0x9e63ba8af688a690 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779795.963656:0:14312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69000/0x9e63ba8af688a690 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779795.963664:0:14312:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69000/0x9e63ba8af688a690 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779795.963670:0:14312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69000/0x9e63ba8af688a690 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779795.963677:0:14312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69000/0x9e63ba8af688a690 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779795.963804:0:14312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787779795.964005:0:14312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ece5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:43b382b8-5aec-409a-8dc5-84d259a200e7+19:14554:x1874622505155840:12345-192.168.201.9@tcp:35:lhsmtool_posix.0 Request processed in 1507us (1753us total) trans 8589934630 rc 0/0 00000100:00100000:0.0:1787779795.964014:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 13 00000020:00080000:0.0:1787779795.964019:0:14312:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787779795.964117:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505155968 00000100:00100000:2.0:1787779795.964125:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505155968 00000100:00100000:2.0:1787779795.964165:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 19 00000100:00100000:2.0:1787779795.964173:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ece70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:43b382b8-5aec-409a-8dc5-84d259a200e7+7:14553:x1874622505155968:12345-192.168.201.9@tcp:101:bash.0 00010000:00010000:2.0:1787779795.964186:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779795.964204:0:14991:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027e32578/0x9e63ba8af688a697 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedb1a4 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787779795.964245:0:14991:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a8f5ad2, atime: 0x6a8f5ad1, ctime: 0x6a8f5ad2, blocks: 0x1 00010000:00010000:2.0:1787779795.964261:0:14991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=561s v=(0 0) 00010000:00010000:2.0:1787779795.964267:0:14991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787779795.964276:0:14991:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027e32578/0x9e63ba8af688a697 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb1a4 expref: 8 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779795.964290:0:14991:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000027e32578/0x9e63ba8af688a697 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb1a4 expref: 8 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779795.964301:0:14991:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e7430d2c00, rc 0) 00000100:00100000:2.0:1787779795.964324:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ece70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:43b382b8-5aec-409a-8dc5-84d259a200e7+8:14553:x1874622505155968:12345-192.168.201.9@tcp:101:bash.0 Request processed in 152us (1996us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779795.964331:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 19 00010000:00010000:1.0:1787779795.964426:0:14297:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787779795.964433:0:14297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69000/0x9e63ba8af688a690 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779795.964440:0:14297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e848f69000 already unused, calling callback (ffffffffc16b2420) 00010000:00010000:1.0:1787779795.964444:0:14297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69000/0x9e63ba8af688a690 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779795.964453:0:14297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69000/0x9e63ba8af688a690 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779795.964467:0:14297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98e87450a500) 00010000:00010000:1.0:1787779795.964470:0:14297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787779795.964474:0:14297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69000/0x9e63ba8af688a690 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779795.964479:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69000/0x9e63ba8af688a690 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779795.964502:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779795.964504:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779795.964506:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779795.970092:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779795.970182:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505156224 00000100:00100000:2.0:1787779795.970192:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505156224 00000100:00100000:2.0:1787779795.970288:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 14 00000100:00100000:2.0:1787779795.970298:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e743506580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:43b382b8-5aec-409a-8dc5-84d259a200e7+19:14553:x1874622505156224:12345-192.168.201.9@tcp:35:bash.0 00000001:00080000:2.0:1787779795.970571:0:14313:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934631 00000001:00080000:2.0:1787779795.970676:0:14313:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934632 00000100:00100000:2.0:1787779795.970936:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e743506580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:43b382b8-5aec-409a-8dc5-84d259a200e7+22:14553:x1874622505156224:12345-192.168.201.9@tcp:35:bash.0 Request processed in 638us (853us total) trans 8589934633 rc 0/0 00000100:00100000:2.0:1787779795.970946:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 14 00000020:00080000:2.0:1787779795.970952:0:14313:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1787779796.044853:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:2.0:1787779796.044923:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505156480 00000100:00100000:2.0:1787779796.044935:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505156480 00000100:00100000:1.0:1787779796.045034:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 61 00000100:00100000:1.0:1787779796.045054:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ab1b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:43b382b8-5aec-409a-8dc5-84d259a200e7+22:14564:x1874622505156480:12345-192.168.201.9@tcp:101:lfs.0 00010000:00010000:1.0:1787779796.045085:0:14311:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779796.045107:0:14311:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94f000/0x9e63ba8af688a69e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb0ea958ceeedb1ab expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787779796.045403:0:14311:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1787779796.045574:0:14311:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94f000/0x9e63ba8af688a69e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb1ab expref: 24 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779796.045590:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e87450ad00) 00010000:00010000:1.0:1787779796.045593:0:14311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787779796.045598:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e87a94f000/0x9e63ba8af688a69e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.9@tcp remote: 0xb0ea958ceeedb1ab expref: 24 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779796.045613:0:14311:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e87a94f000, rc 0) 00000100:00100000:1.0:1787779796.045685:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ab1b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:43b382b8-5aec-409a-8dc5-84d259a200e7+23:14564:x1874622505156480:12345-192.168.201.9@tcp:101:lfs.0 Request processed in 634us (847us total) trans 8589934634 rc 301/301 00000100:00100000:1.0:1787779796.045693:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 61 00000100:00100000:1.0:1787779796.049608:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779796.049706:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505156608 00000100:00100000:0.0:1787779796.049763:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505156608 00000100:00100000:0.0:1787779796.049837:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 62 00000100:00100000:0.0:1787779796.049848:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87fdd2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:43b382b8-5aec-409a-8dc5-84d259a200e7+23:14564:x1874622505156608:12345-192.168.201.9@tcp:34:lfs.0 00010000:00010000:0.0:1787779796.049951:0:14310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af688a6ac lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779796.049969:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af688a6ac lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779796.049981:0:14310:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af688a6ac lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779796.049995:0:14310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af688a6b3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779796.050001:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af688a6b3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779796.050007:0:14310:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af688a6b3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779796.050313:0:14310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69000/0x9e63ba8af688a6ba lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779796.050322:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69000/0x9e63ba8af688a6ba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779796.050329:0:14310:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69000/0x9e63ba8af688a6ba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787779796.050368:0:14310:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69000/0x9e63ba8af688a6ba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779796.050382:0:14310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af688a6ac lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779796.050398:0:14310:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af688a6ac lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779796.050405:0:14310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af688a6ac lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779796.050411:0:14310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e848f69600 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:0.0:1787779796.050416:0:14310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af688a6ac lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779796.050424:0:14310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af688a6ac lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779796.050435:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98e87450a400) 00010000:00010000:0.0:1787779796.050439:0:14310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787779796.050443:0:14310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af688a6ac lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779796.050450:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69600/0x9e63ba8af688a6ac lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779796.050462:0:14310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af688a6b3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779796.050469:0:14310:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af688a6b3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779796.050475:0:14310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af688a6b3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779796.050480:0:14310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e848f69800 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:0.0:1787779796.050490:0:14310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af688a6b3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779796.050497:0:14310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af688a6b3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779796.050505:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff98e860e78a00) 00010000:00010000:0.0:1787779796.050508:0:14310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787779796.050511:0:14310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af688a6b3 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779796.050518:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69800/0x9e63ba8af688a6b3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779796.050533:0:14310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69000/0x9e63ba8af688a6ba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779796.050540:0:14310:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69000/0x9e63ba8af688a6ba lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779796.050545:0:14310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69000/0x9e63ba8af688a6ba lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779796.050550:0:14310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e848f69000 already unused, calling callback (ffffffffc20f74f0) 00010000:00010000:0.0:1787779796.050553:0:14310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69000/0x9e63ba8af688a6ba lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779796.050558:0:14310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69000/0x9e63ba8af688a6ba lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779796.050565:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98e846377800) 00010000:00010000:0.0:1787779796.050567:0:14310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787779796.050576:0:14310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69000/0x9e63ba8af688a6ba lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779796.050583:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e848f69000/0x9e63ba8af688a6ba lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779796.050662:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87fdd2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:43b382b8-5aec-409a-8dc5-84d259a200e7+23:14564:x1874622505156608:12345-192.168.201.9@tcp:34:lfs.0 Request processed in 815us (1062us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779796.050671:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 62 00000100:00100000:2.0:1787779796.056105:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:1.0:1787779796.056199:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505156864 00000100:00100000:1.0:1787779796.056210:0:14312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505156864 00000100:00100000:1.0:1787779796.056273:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 15 00000100:00100000:1.0:1787779796.056284:0:14312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec99a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:43b382b8-5aec-409a-8dc5-84d259a200e7+23:14564:x1874622505156864:12345-192.168.201.9@tcp:35:lfs.0 00000100:00100000:1.0:1787779796.056780:0:14312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec99a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:43b382b8-5aec-409a-8dc5-84d259a200e7+24:14564:x1874622505156864:12345-192.168.201.9@tcp:35:lfs.0 Request processed in 496us (682us total) trans 8589934635 rc 0/0 00000100:00100000:1.0:1787779796.056802:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 15 00010000:00010000:1.0:1787779796.467020:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779796.651226:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779796.653008:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779796.653057:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779796.653077:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779796.653116:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.9@tcp (source: 12345-192.168.201.9@tcp) 00000100:00100000:0.0:1787779796.653176:0:16506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505157504 00000100:00100000:0.0:1787779796.653187:0:16506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505157504 00000100:00100000:0.0:1787779796.653265:0:16506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505157120 00000100:00100000:0.0:1787779796.653270:0:16506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505157120 00000100:00100000:0.0:1787779796.653283:0:16506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505157376 00000100:00100000:0.0:1787779796.653284:0:16506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505157376 00000100:00100000:0.0:1787779796.653300:0:16506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 17 00000100:00100000:0.0:1787779796.653309:0:16506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e845d2c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9f07da6d-bdd3-44fa-ab17-edf321a3c5bb+5:2358:x1874622505157504:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:0.0:1787779796.653392:0:16506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e845d2c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9f07da6d-bdd3-44fa-ab17-edf321a3c5bb+5:2358:x1874622505157504:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 84us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779796.653400:0:16506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 17 00000100:00100000:0.0:1787779796.653419:0:16506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 18 00000100:00100000:0.0:1787779796.653425:0:16506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e845d2fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:43b382b8-5aec-409a-8dc5-84d259a200e7+5:2358:x1874622505157120:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:0.0:1787779796.653449:0:16506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e845d2fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:43b382b8-5aec-409a-8dc5-84d259a200e7+5:2358:x1874622505157120:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 25us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779796.653475:0:16506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 18 00000100:00100000:0.0:1787779796.654262:0:16506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 19 00000100:00100000:0.0:1787779796.654276:0:16506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e845d2d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9f07da6d-bdd3-44fa-ab17-edf321a3c5bb+5:2358:x1874622505157376:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:0.0:1787779796.654313:0:16506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e845d2d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9f07da6d-bdd3-44fa-ab17-edf321a3c5bb+5:2358:x1874622505157376:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 44us (1197us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779796.654319:0:16506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 19 00000100:00100000:1.0:1787779796.654957:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505157248 00000100:00100000:1.0:1787779796.654966:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505157248 00000100:00100000:1.0:1787779796.655021:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 30 00000100:00100000:1.0:1787779796.655028:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87ec9cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9f07da6d-bdd3-44fa-ab17-edf321a3c5bb+6:2358:x1874622505157248:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:1.0:1787779796.655070:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87ec9cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9f07da6d-bdd3-44fa-ab17-edf321a3c5bb+6:2358:x1874622505157248:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 44us (2074us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779796.655077:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 30 00000100:00080000:0.0:1787779796.655161:0:14305:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787779796.655167:0:14305:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787779796.655169:0:14305:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787779796.662108:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622505156992 00000100:00100000:3.0:1787779796.662123:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622505156992 00000100:00100000:3.0:1787779796.662191:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.9@tcp, seq: 122 00000100:00100000:3.0:1787779796.662202:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e84517ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b38d1ba0-13da-4ef7-a48d-bd7b24ab8218+13:2358:x1874622505156992:12345-192.168.201.9@tcp:400:kworker.0 00000100:00100000:3.0:1787779796.662287:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e84517ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b38d1ba0-13da-4ef7-a48d-bd7b24ab8218+13:2358:x1874622505156992:12345-192.168.201.9@tcp:400:kworker.0 Request processed in 88us (11630us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779796.662295:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.9@tcp, seq: 122 00010000:00010000:1.0:1787779797.495078:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787779797.733508:0:16580:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00000100:00100000:1.0:1787779797.942290:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87aa30780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:3304:1874622525063296:0@lo:400:kworker.0 00000100:00100000:1.0:1787779797.942369:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779797.942433:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87aa33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874622525063808:0@lo:400:kworker.0 00000100:00100000:1.0:1787779797.942462:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779797.942497:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787779797.942503:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87aa312c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874622525063424:0@lo:400:kworker.0 00000100:00100000:1.0:1787779797.942526:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779797.942544:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87aa31a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874622525063936:0@lo:400:kworker.0 00000100:00100000:1.0:1787779797.942570:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779797.942594:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87aa321c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622525063552:0@lo:400:kworker.0 00000100:00100000:1.0:1787779797.942676:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779797.942762:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87aa31680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874622525063680:0@lo:400:kworker.0 00000100:00100000:1.0:1787779797.942786:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779797.942817:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525063296 00000100:00100000:1.0:1787779797.942847:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525063296 00000100:00100000:1.0:1787779797.942905:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787779797.942913:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e84517d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+19:3304:x1874622525063296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779797.942968:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e84517d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105+19:3304:x1874622525063296:12345-0@lo:400:kworker.0 Request processed in 55us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779797.942976:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787779797.943011:0:16506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525063424 00000100:00100000:1.0:1787779797.943014:0:16506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525063424 00000100:00100000:1.0:1787779797.943058:0:16506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525063552 00000100:00100000:1.0:1787779797.943061:0:16506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525063552 00000100:00100000:1.0:1787779797.943082:0:16506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787779797.943089:0:16506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87aa32580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874622525063424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779797.943121:0:16506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87aa32580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874622525063424:12345-0@lo:400:kworker.0 Request processed in 34us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779797.943128:0:16506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787779797.943139:0:16506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787779797.943145:0:16506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87aa30f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3306:x1874622525063552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779797.943173:0:16506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87aa30f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3306:x1874622525063552:12345-0@lo:400:kworker.0 Request processed in 27us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779797.943179:0:16506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787779797.943197:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525063808 00000100:00100000:1.0:1787779797.943201:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525063808 00000100:00100000:1.0:1787779797.943227:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525063936 00000100:00100000:1.0:1787779797.943230:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525063936 00000100:00100000:1.0:1787779797.943244:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525063680 00000100:00100000:1.0:1787779797.943246:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525063680 00000100:00100000:1.0:1787779797.943260:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787779797.943266:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87aa32d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874622525063808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779797.943310:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87aa32d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874622525063808:12345-0@lo:400:kworker.0 Request processed in 45us (848us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779797.943317:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787779797.943330:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787779797.943336:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87aa33840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874622525063936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779797.943362:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87aa33840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874622525063936:12345-0@lo:400:kworker.0 Request processed in 27us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779797.943368:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787779797.943379:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787779797.943385:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87aa303c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874622525063680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779797.943419:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87aa303c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874622525063680:12345-0@lo:400:kworker.0 Request processed in 35us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779797.943425:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787779797.943479:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87aa321c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874622525063552:0@lo:400:kworker.0 00000100:00100000:1.0:1787779797.943513:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87aa31680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874622525063680:0@lo:400:kworker.0 00000100:00100000:1.0:1787779797.943626:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87aa312c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874622525063424:0@lo:400:kworker.0 00000100:00100000:1.0:1787779797.943635:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87aa31a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874622525063936:0@lo:400:kworker.0 00000100:00100000:1.0:1787779797.943643:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87aa30780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cfa2fcc8-6c77-47ab-93f3-f9e1ecbcb105:3304:1874622525063296:0@lo:400:kworker.0 00000100:00100000:1.0:1787779797.943651:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87aa33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874622525063808:0@lo:400:kworker.0 00000100:00080000:0.0:1787779797.945090:0:14305:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787779797.945101:0:14305:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787779797.945105:0:14305:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787779797.956935:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787779797.956960:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e845d2cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622525064064:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787779797.957030:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779797.957081:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525064064 00000100:00100000:0.0:1787779797.957088:0:14996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525064064 00000100:00100000:0.0:1787779797.957134:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787779797.957318:0:14996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e845d2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1874622525064064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787779797.957354:0:14996:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787779797.957629:0:14996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e845d2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1874622525064064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 315us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779797.957638:0:14996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787779797.958368:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e845d2cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622525064064:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1787779798.020661:0:7634:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00000001:00080000:0.0:1787779798.020679:0:7634:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934596 is committed 00010000:00010000:1.0:1787779798.515070:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779798.965686:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e87aa33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622525064192:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787779798.965999:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779798.966124:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622525064192 00000100:00100000:0.0:1787779798.966139:0:14996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622525064192 00000100:00100000:0.0:1787779798.966197:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787779798.966208:0:14996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e87aa30780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622525064192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787779798.966247:0:14996:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787779798.966302:0:14996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e87aa30780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874622525064192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779798.966310:0:14996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787779798.966358:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e87aa33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874622525064192:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1787779799.031587:0:14343:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787779799.031599:0:14343:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787779799.031645:0:14343:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1787779799.031651:0:14343:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 Debug log: 30148 lines, 30148 kept, 0 dropped, 0 bad.